-- Logs begin at Wed 2022-01-19 12:26:10 UTC, end at Wed 2022-01-19 13:31:40 UTC. -- Jan 19 12:55:54.689558 dv-cinder-823015-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 19 12:55:54.698160 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 19 12:55:54.700090 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jan 19 12:55:54 2022] *** Jan 19 12:55:54.700090 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 19 12:55:54.700090 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 19 12:55:54.700090 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: nodename: dv-cinder-823015-4-iscsi Jan 19 12:55:54.700090 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: machine: x86_64 Jan 19 12:55:54.700090 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: clock source: unix Jan 19 12:55:54.700090 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: pcre jit disabled Jan 19 12:55:54.700090 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: detected number of CPU cores: 4 Jan 19 12:55:54.700090 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: current working directory: / Jan 19 12:55:54.700090 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: detected binary path: /usr/bin/uwsgi-core Jan 19 12:55:54.700090 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: your processes number limit is 47680 Jan 19 12:55:54.700090 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: your memory page size is 4096 bytes Jan 19 12:55:54.700090 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: detected max file descriptor number: 2048 Jan 19 12:55:54.700090 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: lock engine: pthread robust mutexes Jan 19 12:55:54.700942 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: thunder lock: enabled Jan 19 12:55:54.700942 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 19 12:55:54.700942 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 19 12:55:54.745247 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: Python main interpreter initialized at 0x5634c24df9c0 Jan 19 12:55:54.745247 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: python threads support enabled Jan 19 12:55:54.745247 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: your server socket listen backlog is limited to 100 connections Jan 19 12:55:54.745247 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: your mercy for graceful operations on workers is 90 seconds Jan 19 12:55:54.745568 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: mapped 403077 bytes (393 KB) for 2 cores Jan 19 12:55:54.745642 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: *** Operational MODE: preforking *** Jan 19 12:55:54.745898 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: *** uWSGI is running in multiple interpreter mode *** Jan 19 12:55:54.745898 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: spawned uWSGI master process (pid: 101952) Jan 19 12:55:54.746082 dv-cinder-823015-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 19 12:55:54.752215 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: spawned uWSGI worker 1 (pid: 101953, cores: 1) Jan 19 12:55:54.752215 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: spawned uWSGI worker 2 (pid: 101954, cores: 1) Jan 19 12:55:54.752215 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 19 12:55:56.537868 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 12:55:56.537868 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: from cryptography.utils import int_from_bytes Jan 19 12:55:56.538571 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 12:55:56.538571 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: from cryptography.utils import int_from_bytes Jan 19 12:55:56.560341 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 12:55:56.560341 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: from cryptography.utils import int_from_bytes Jan 19 12:55:56.560884 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 12:55:56.560884 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: from cryptography.utils import int_from_bytes Jan 19 12:55:59.134881 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 12:55:59.135476 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 12:55:59.135574 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 12:55:59.135574 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 12:55:59.136022 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 12:55:59.136126 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 12:55:59.136206 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 12:55:59.136206 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 12:55:59.136347 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 12:55:59.136513 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 12:55:59.136607 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.136861 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.136948 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.137183 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.137276 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.137504 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.137597 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.137825 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.137921 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.138138 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.138222 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.138451 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.138542 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.138770 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.138853 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.139924 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.140048 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.140217 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.140542 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.140645 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.140868 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-823015-4-iscsi {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.141017 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.141195 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.141368 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.141509 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.141705 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-823015-4-iscsi {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.141796 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.142038 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.142131 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.142359 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.142456 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.142676 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.142767 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.143002 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.143099 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.143315 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.143508 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.143644 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.143943 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.144120 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.144273 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.144481 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.144584 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.144798 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.144916 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.145092 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.145246 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.145411 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.145538 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.145751 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.145863 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.146072 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.146158 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.146392 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.146530 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.146716 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.146813 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.147030 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.147156 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-823015-4-iscsi {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.147357 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.147481 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.147671 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.147800 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.148100 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-823015-4-iscsi {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.148188 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.148425 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.148550 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.148745 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.148866 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.149065 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.149180 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.149480 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.149567 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.149796 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.149888 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.150115 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.150213 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.150440 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.150530 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.150760 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.150849 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.151076 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.151170 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.151395 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.151482 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.151702 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.151801 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.152036 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.152123 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.152350 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.152501 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.152661 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.152753 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.152969 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.153051 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.153278 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.153369 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.153530 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.153615 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.153842 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.153927 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.154169 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.154305 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.154430 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.154521 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.154832 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.155045 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.155142 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.155247 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.155497 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.155599 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.155822 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.155907 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.156105 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.156205 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.156366 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.156462 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.156686 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.156771 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.157010 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.157095 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.157322 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.157405 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.157634 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.157726 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.157945 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.158042 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.158252 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.158336 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.158558 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.158653 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.158868 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.158952 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.159178 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.159262 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.159490 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.159582 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.159798 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.159888 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.160174 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.160273 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.160462 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.160558 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.160775 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.160866 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.161084 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.161168 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.161427 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.161513 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.161723 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.161855 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.162036 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.162128 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.162356 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.162441 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.162685 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.162768 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.162995 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.163098 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.163305 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.163390 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.163616 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.163701 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.163926 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.164086 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.164265 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.164351 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.164577 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.164661 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.164828 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.164920 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.165138 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.165252 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.165446 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.165538 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.165759 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.165861 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.166065 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.166159 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.166374 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.166463 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.166684 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.166785 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.166989 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.167085 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.167296 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.167384 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.167604 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.167699 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.167907 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.168019 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.168237 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.168332 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.168545 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.168642 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.168851 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.168948 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.169158 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.169245 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.169467 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.169555 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.169771 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.169858 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.170083 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.170172 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.170421 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.170555 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.170730 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.170878 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.171051 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.171188 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.171373 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.171498 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.171684 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.171810 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.172023 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.172158 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.172327 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.172470 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.172638 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.172786 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.172961 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.173093 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.173272 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.173409 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.173582 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.173717 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.173906 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.174038 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.174216 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.174348 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.174527 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.174657 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.174849 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.174979 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.175146 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.175284 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.175458 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.175593 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.175782 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.175913 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.176119 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.176251 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.176438 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.176562 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.176760 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.176856 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.177070 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.177164 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.177381 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.177466 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.177692 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.177785 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.178000 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.178084 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.178310 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.178395 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.178619 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.178715 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.178927 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.179012 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.179236 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.179328 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.179539 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.179632 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.179847 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.179931 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.180182 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.180267 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.180497 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.180602 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.180809 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.180899 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.181117 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.181212 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.181441 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 12:55:59.181530 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.181780 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.181868 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.182113 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.182205 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.182444 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.182531 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.182765 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.182863 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.183078 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.183161 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.183404 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.183489 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.183730 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.183812 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.184067 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.184174 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.184385 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.184476 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.184701 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.184785 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.185016 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.185108 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.185333 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.185416 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.185653 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.185735 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.186491 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.186597 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.186821 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.186914 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.187155 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.187247 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.187478 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.187574 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.187797 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.187881 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.188147 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.188235 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.188467 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.188563 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.188780 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.188863 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.189108 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.189198 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.189433 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.189526 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.189745 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.189830 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.190072 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.190154 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.190389 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.190475 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.190720 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.190817 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.191036 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.191128 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.191349 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.191434 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.191665 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.191748 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.192005 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.192092 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.192316 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.192402 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.192628 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.192719 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.192958 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.193042 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.193275 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.193360 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.193590 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.193682 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.193904 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.193996 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.194215 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.194299 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.194523 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.194615 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.194834 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.194925 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.195141 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.195232 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.195448 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.195531 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.195763 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.195860 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.196096 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.196194 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.196420 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.196504 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.196733 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.196824 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.197051 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.197134 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.197367 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.197452 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.197673 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.197759 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.197984 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.198075 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.198299 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.198390 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.198607 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.198695 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.198922 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.199007 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.199237 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.199321 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.199543 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.199634 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.199868 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.199952 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.200205 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.200290 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.200510 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.200595 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.200830 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.200932 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.201133 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.201225 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.201441 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.202136 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.202334 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.202469 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.202649 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.202746 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.202967 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.203052 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.203280 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.203363 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.203602 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.203693 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.203920 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.204027 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.204262 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.204347 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.204588 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.204683 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.204917 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.205009 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.205226 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.205309 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.205534 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.205625 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.205849 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.205933 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.206161 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.206255 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.206468 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.206558 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.206774 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.206857 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.207082 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.207172 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.207389 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.207472 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.207692 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.207781 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.208018 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.208105 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.208330 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.208415 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.208637 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.208720 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.208940 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.209031 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.209246 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.209331 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.209553 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.209637 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.209859 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.209950 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.210168 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.210253 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.210475 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.210557 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.210801 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.210948 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.211090 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.211182 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.211434 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.211519 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.211742 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.211834 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.212108 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.212196 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.212425 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.212564 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.212747 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.212832 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.213062 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.213191 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.213376 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.213460 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.213693 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.213778 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.214005 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.214087 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.214320 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.214403 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.214631 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.214722 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.214943 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.215025 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.215255 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.215338 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.215565 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.215685 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.215879 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.215962 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.216215 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.216301 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.216524 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.216608 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.216843 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.216926 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.217234 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.217428 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.217565 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.217652 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.217884 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.217976 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.218226 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.218324 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.218563 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.218647 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.218884 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.218975 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.219195 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.219291 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.219510 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.219593 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.219819 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.219909 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.220156 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.220256 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.220468 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.220558 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.220780 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.220864 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.221091 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.221176 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.221402 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.221486 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.221713 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.221804 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.222028 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.222113 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.222337 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.222420 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.222643 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.222728 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.222959 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.223042 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.223279 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.223364 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.223585 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.223669 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.223901 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.224071 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.224247 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.224341 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.224571 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.224668 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.224881 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.224964 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.225192 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.225276 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.225508 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.225600 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.225817 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.225901 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.226126 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.226210 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.226435 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.226530 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.226748 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.226832 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.227056 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.227140 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.227368 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.227463 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.227676 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.227768 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.228000 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.228098 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.228315 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.228400 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.228619 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.228709 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.228922 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.229004 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.229235 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.229320 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.229542 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.229625 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.229851 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.229935 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.230170 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.230256 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.230490 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.230573 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.230799 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.230883 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.231109 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.231243 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.231432 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.231516 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.231739 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.231822 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.232069 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.232166 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.232381 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.232465 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.232690 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.232817 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.233057 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.233148 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.233421 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.233504 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.233732 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.233825 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.234053 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.234137 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.234381 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.234465 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.234687 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.234780 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.235003 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.235093 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.235317 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.235409 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.235627 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.235723 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.235948 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.236056 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.236286 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.236371 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.236648 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.236743 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.236911 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.237002 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.237227 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.237311 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.237537 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.237628 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.237848 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.237931 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.238158 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.238241 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.238472 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.238564 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.238784 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.238908 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.239097 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.239182 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.239407 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.239491 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.239720 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.239803 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.240053 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.240157 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.240364 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.240630 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.240715 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.240973 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.241057 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.241298 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.241539 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.241626 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.241877 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.241961 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.242197 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.242290 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.242521 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.242605 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.242845 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.242929 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.243166 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.243252 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.243487 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.243570 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.243803 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.243887 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.244146 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.244234 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.244456 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.244541 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.244768 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.244852 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.245075 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.245166 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.245382 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.245465 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.245691 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.245776 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.245999 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.246083 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.246305 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.246396 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.246611 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.246695 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.246934 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.247020 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.247244 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.247335 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.247549 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.247634 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.247854 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.247949 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.248196 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.248284 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.249050 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.249155 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.249364 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.249545 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.249684 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.249865 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.249980 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.250176 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.250289 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.250486 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.250605 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.250798 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.250915 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.251144 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.251230 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.251458 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.251555 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.251796 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.251882 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.252162 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.252252 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.252501 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.252587 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.252812 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.252945 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.253125 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.253219 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.253455 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.253542 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.253760 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.253844 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.254073 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.254184 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.254380 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.254470 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.254688 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.254772 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.254995 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.255087 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.255305 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.255402 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.255613 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.255705 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.255920 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.256042 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.256260 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.256349 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.256572 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.256655 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.256879 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.256972 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.257194 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.257285 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.257500 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.257591 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.257813 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.257898 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.258121 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.258226 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.258430 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.258513 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.258739 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.258831 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.259045 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.259129 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.259350 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.259434 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.259656 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.259740 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.259963 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.260066 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.260290 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.260378 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.260603 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.260689 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.260907 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.260999 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.261214 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.261305 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.261518 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.261605 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.261824 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.261908 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.262130 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.262227 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.262435 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.262519 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.262743 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.262825 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.263047 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.263157 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.263361 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.263450 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.263668 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.263753 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.263971 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.264697 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.264940 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.265046 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.265265 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.265356 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.265568 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.265661 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.265878 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.265963 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.266194 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.266278 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.266499 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.266584 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.266815 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.266899 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.267119 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.267203 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.267424 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.267509 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.267730 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.267813 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.268064 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.268152 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.268372 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.268457 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.268680 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.268771 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.268986 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.269077 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.269288 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.269371 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.269593 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.269676 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.269897 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.269990 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.270203 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.270288 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.270511 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.270601 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.270821 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.270914 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.271125 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.271209 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.271433 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.271574 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.271738 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.271832 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.272108 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.272207 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.272415 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.272500 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.272737 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.272828 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.273059 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.273143 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.273374 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.273464 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.273685 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.273776 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.273997 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.274080 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.274303 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.274385 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.274614 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.274699 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.274921 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.275006 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.275235 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.275319 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.275543 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.275628 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.275848 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.275933 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.276195 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.276280 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.276499 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.276583 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.276813 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.276902 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.277124 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.277215 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.277444 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.277528 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.277763 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.277845 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.278069 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.278165 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.278381 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.278474 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.278686 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.278776 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.278995 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.279090 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.279306 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.279388 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.279631 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.279730 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.279950 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.280105 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.280296 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.280459 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.280610 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.280779 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.280923 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.281094 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.281236 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.281406 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.281545 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.281724 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.281847 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.282041 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.282158 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.282348 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.282466 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.282662 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.282822 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.282974 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.283091 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.283280 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.283398 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.283608 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.283704 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.283923 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.284027 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.284258 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.284344 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.284570 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.284656 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.284878 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.285043 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.285193 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.285360 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.285501 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.285676 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.285930 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.286078 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.286248 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.286399 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.286565 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.286713 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.286872 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.287031 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.287185 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.287351 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.287504 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.287663 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.287822 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.288108 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.288197 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.288427 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.288513 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.288741 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.288868 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.289056 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.289185 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.289365 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.289498 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.289672 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.289812 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.289989 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.290118 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.290317 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.290424 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.290623 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.290738 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.290930 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.291065 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.291236 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.291372 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.291560 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.291679 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.291887 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.292001 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.292212 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.292319 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.292625 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.292720 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.292939 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.293030 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.293248 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.293386 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.293653 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.293738 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.293962 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.294054 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.294273 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.294378 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.294600 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.294690 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.294923 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.295021 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.295276 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.295371 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.295617 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.295909 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.296029 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.296261 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.296357 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.296576 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.296659 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.296896 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.296988 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.297207 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.297300 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.297524 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.297616 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.297831 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.297969 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.298178 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.298271 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.298498 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.298582 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.298806 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.298897 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.299130 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.299215 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.299457 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.299541 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.299774 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.299859 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.300123 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.300211 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.300510 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.300604 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.300840 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.300926 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.301152 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.301238 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.301463 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.301548 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.301780 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.301923 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.302094 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.302207 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.302400 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.302491 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.302711 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.302808 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.303019 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.303118 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.303325 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.303439 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.303645 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.303749 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.303949 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.304091 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.304281 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.304365 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.304591 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.304685 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.304902 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.304986 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.305212 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.305294 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.305515 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.305607 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.305838 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.305929 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.306148 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.306233 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.306473 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.306569 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.306782 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.306870 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.307103 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.307186 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.307413 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.307506 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.307725 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.307811 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.308066 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.308156 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.308378 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.308464 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.308684 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.308774 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.308993 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.309077 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.309299 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.309391 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.309642 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.309728 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.309948 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.310034 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.310273 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.310358 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.310605 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.310689 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.311460 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.311555 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.311790 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.311875 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.312197 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.312315 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.312527 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.312631 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.312845 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.312939 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.313156 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.313255 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.313475 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.313578 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.313782 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.313888 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.314092 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.314185 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.314401 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.314495 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.314707 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.314792 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.315014 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.315100 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.315321 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.315418 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.315629 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.315715 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.315934 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.316040 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.316274 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.316360 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.316578 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.316661 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.316901 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.316990 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.317208 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.317298 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.317518 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.317662 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.317828 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.317920 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.318137 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.318222 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.318444 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.318535 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.318751 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.318834 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.319095 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.319181 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.319403 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.319486 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.319738 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.319829 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.320086 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.320174 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.320405 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.320489 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.320725 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.320819 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.321039 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.321122 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.321360 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.321445 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.321678 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.321773 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.321998 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.322127 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.322317 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.322421 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.322634 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.322731 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.322949 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.323043 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.323265 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.323349 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.323582 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.323670 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.323894 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.324020 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.324251 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.324440 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.324571 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.324773 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.324893 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.325094 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.325413 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.325498 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.325731 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.325816 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.326047 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.326133 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.326364 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.326448 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.327235 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.327431 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.327555 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.327769 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.327861 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.328206 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.328426 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.328513 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.328752 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.328840 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.329090 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.329183 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.329422 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.329507 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.329756 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.329848 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.330084 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.330176 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.330413 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.330497 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.330733 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.330843 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.331054 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.331140 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.331372 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.331457 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.331693 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.331784 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.332065 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.332193 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.332388 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.332503 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.332695 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.332801 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.333015 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.333111 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.333332 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.333426 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.333646 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.333748 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.333960 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.334061 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.334272 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.334364 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.334589 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.334683 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.334905 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.334997 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.335219 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.335312 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.335536 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.335630 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.335853 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.335955 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.336197 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.336290 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.336526 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.336627 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.336849 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.336945 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.337173 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.337291 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.337562 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.337661 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.337807 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.337899 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.338132 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.338323 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.338645 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.338743 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.338961 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.339053 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.339297 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.339406 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.339624 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.339716 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.339945 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.340081 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.340289 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.340390 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.340611 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.340695 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.340919 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.341001 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.341228 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.341314 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.341533 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.341617 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.341846 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.341938 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.342204 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.342301 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.342505 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.342595 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.342848 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.342999 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.343148 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.343284 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.343430 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.343564 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.343731 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.343866 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.344068 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.344298 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.344600 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.344705 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.344950 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.345044 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.345270 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.345355 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.345595 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.345680 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.345917 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.346011 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.346228 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.346313 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.346540 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.346632 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.346854 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.346951 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.347160 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.347252 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.347470 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.347596 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.347783 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.347879 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.348116 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.348219 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.348425 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.348512 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.348734 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.348821 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.349046 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.349130 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.349355 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.349440 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.349662 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.349747 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.349968 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.350052 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.350274 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.350358 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.350593 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.350678 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.350901 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.350985 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.351207 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.351297 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.351513 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.351604 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.351819 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.351911 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.352152 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.352255 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.352464 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.352574 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.352769 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.352865 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.353070 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.353334 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.353439 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.353518 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.353675 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.353763 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.353985 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.354079 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.354294 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.354414 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.354599 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.354692 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.354904 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.354998 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.355209 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.355337 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.355515 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.355600 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.355829 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.355915 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.356163 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.356262 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.356467 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.356553 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.356785 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.356871 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.357098 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.357184 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.357413 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.357497 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.357744 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.357954 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.358073 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.358150 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.358416 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.358500 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.358734 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.358946 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.359266 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.359353 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.359637 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.359730 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.359968 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.360074 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.360328 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.360414 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.360641 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.360799 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.360951 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.361038 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.361260 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.361344 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.361571 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.361674 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.361893 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.361978 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.362207 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.362293 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.362525 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.362644 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.362837 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.362937 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.363149 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.363301 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.363456 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.363544 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.363770 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.363855 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.364111 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.364200 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.364430 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.364522 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.364744 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.364829 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.365058 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.365152 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.365392 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.365496 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.365708 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.365794 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.366028 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.366121 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.366344 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.366429 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.366661 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.366745 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.366974 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.367066 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.367286 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.367382 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.367597 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.367681 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.367908 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.368097 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.368248 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.368334 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.368569 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.368656 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.368884 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.368978 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.369193 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.369287 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.369501 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.369612 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.369919 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.370007 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.370236 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.370323 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.370557 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.370643 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.370871 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.370958 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.371183 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.371267 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.371507 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.371604 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.371830 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.371917 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.372174 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.372263 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.372499 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.372607 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.372818 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.372972 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.373148 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.373236 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.374003 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.374111 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.374348 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.374447 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.374661 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.374747 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.374974 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.375061 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.375284 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.375371 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.375599 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.375685 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.375935 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.376040 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.376294 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.376379 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.376615 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.376700 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.376934 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.377021 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.377247 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.377332 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.377561 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.377646 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.377870 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.377964 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.378192 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.378280 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.378512 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.378605 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.378834 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.378919 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.379147 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.379233 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.379459 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.379553 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.379786 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.379870 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.380123 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.380213 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.380439 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.380541 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.380752 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.380848 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.381061 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.381147 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.381371 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.381472 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.381684 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.381770 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.382011 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.382096 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.382323 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.382409 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.382633 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.382718 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.382961 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.383093 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.383279 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.383366 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.383596 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.383680 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.383911 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.384038 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.384257 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.384343 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.384569 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.384653 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.384936 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.385038 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.385207 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.385293 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.385519 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.385604 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.385834 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.385928 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.386152 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.386236 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.386471 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.386557 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.386802 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.386895 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.387131 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.387216 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.387459 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.387552 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.387787 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.387882 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.388173 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.388263 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.388491 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.388577 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.388833 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.388919 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.389244 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.389341 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.389947 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.390052 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.390196 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.390284 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.390444 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 12:55:59.390530 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 12:55:59.390758 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 12:55:59.413604 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_db.sqlalchemy.engines [None req-7cc5d69b-6473-4022-b2c2-35aeb5cdf51c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 12:55:59.414442 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG oslo_db.sqlalchemy.engines [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 12:55:59.480830 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.context [None req-7cc5d69b-6473-4022-b2c2-35aeb5cdf51c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f40e5328-425f-45ad-99cf-718290ac762d(cell1) {{(pid=101953) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 12:55:59.481926 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.context [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f40e5328-425f-45ad-99cf-718290ac762d(cell1) {{(pid=101954) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 12:55:59.485068 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-7cc5d69b-6473-4022-b2c2-35aeb5cdf51c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 12:55:59.486257 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG oslo_concurrency.lockutils [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 12:55:59.486698 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-7cc5d69b-6473-4022-b2c2-35aeb5cdf51c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 12:55:59.487503 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-7cc5d69b-6473-4022-b2c2-35aeb5cdf51c None None] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 12:55:59.488035 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG oslo_concurrency.lockutils [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 12:55:59.488857 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG oslo_concurrency.lockutils [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 12:55:59.489472 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-7cc5d69b-6473-4022-b2c2-35aeb5cdf51c None None] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 12:55:59.490777 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG oslo_concurrency.lockutils [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 12:55:59.499791 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_db.sqlalchemy.engines [None req-7cc5d69b-6473-4022-b2c2-35aeb5cdf51c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 12:55:59.502167 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_db.sqlalchemy.engines [None req-7cc5d69b-6473-4022-b2c2-35aeb5cdf51c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 12:55:59.506186 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG oslo_db.sqlalchemy.engines [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 12:55:59.508501 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG oslo_db.sqlalchemy.engines [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 12:55:59.671070 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_db.sqlalchemy.engines [None req-7cc5d69b-6473-4022-b2c2-35aeb5cdf51c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 12:55:59.673434 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG oslo_db.sqlalchemy.engines [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 12:56:00.013215 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: WARNING keystonemiddleware.auth_token [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 12:56:00.015777 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: WARNING keystonemiddleware.auth_token [None req-7cc5d69b-6473-4022-b2c2-35aeb5cdf51c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 12:56:00.020102 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: WARNING keystonemiddleware.auth_token [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 12:56:00.022587 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: WARNING keystonemiddleware.auth_token [None req-7cc5d69b-6473-4022-b2c2-35aeb5cdf51c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 12:56:00.359964 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: WARNING keystonemiddleware.auth_token [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 12:56:00.365297 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: WARNING keystonemiddleware.auth_token [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 12:56:00.365676 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: WARNING keystonemiddleware.auth_token [None req-7cc5d69b-6473-4022-b2c2-35aeb5cdf51c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 12:56:00.370431 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5634c24df9c0 pid: 101954 (default app) Jan 19 12:56:00.370904 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: WARNING keystonemiddleware.auth_token [None req-7cc5d69b-6473-4022-b2c2-35aeb5cdf51c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 12:56:00.372473 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:56:00.373699 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001760 Jan 19 12:56:00.374111 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Wed Jan 19 12:56:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:56:00.376411 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5634c24df9c0 pid: 101953 (default app) Jan 19 12:57:25.638135 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:57:25.639267 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001827 Jan 19 12:57:25.639835 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Wed Jan 19 12:57:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:57:26.069514 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-94238727-c326-40a3-88dd-3285e6c8fbfc admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:57:26.100554 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-94238727-c326-40a3-88dd-3285e6c8fbfc admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.453647 Jan 19 12:57:26.107943 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Wed Jan 19 12:57:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 12:57:28.351378 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:57:28.352480 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-df482f60-56a6-4fa1-9617-2ec833728079 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jan 19 12:57:28.352879 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Wed Jan 19 12:57:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:57:28.418205 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-6f26a177-5192-4aa3-8f7d-c17075bc8ba5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "swap": 0, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:28.436397 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 12:57:28.436397 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: warnings.warn(msg) Jan 19 12:57:28.463863 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-6f26a177-5192-4aa3-8f7d-c17075bc8ba5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104318 Jan 19 12:57:28.464645 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Wed Jan 19 12:57:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 12:57:28.680907 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-56c0816f-eb1c-4f50-a172-3bf7fb2ae1d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:28.683753 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 12:57:28.683753 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: warnings.warn(msg) Jan 19 12:57:28.731376 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-56c0816f-eb1c-4f50-a172-3bf7fb2ae1d4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.258941 Jan 19 12:57:28.732217 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Wed Jan 19 12:57:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 12:57:31.065225 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-6f26a177-5192-4aa3-8f7d-c17075bc8ba5 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:57:31.066359 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-6f26a177-5192-4aa3-8f7d-c17075bc8ba5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Jan 19 12:57:31.066766 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Wed Jan 19 12:57:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:57:31.174984 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-7b0de2d7-b6b1-4994-aba9-f97c40601716 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 5, "ram": 512, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:31.193583 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 12:57:31.193583 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: warnings.warn(msg) Jan 19 12:57:31.214498 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-7b0de2d7-b6b1-4994-aba9-f97c40601716 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141572 Jan 19 12:57:31.215074 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Wed Jan 19 12:57:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 12:57:31.233100 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-6d4bd844-6a54-4a56-bc5c-841d73b5be94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:31.234585 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 12:57:31.234585 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: warnings.warn(msg) Jan 19 12:57:31.267349 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-6d4bd844-6a54-4a56-bc5c-841d73b5be94 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038750 Jan 19 12:57:31.267933 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Wed Jan 19 12:57:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 12:57:33.543287 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-7b0de2d7-b6b1-4994-aba9-f97c40601716 admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:57:33.544327 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-7b0de2d7-b6b1-4994-aba9-f97c40601716 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jan 19 12:57:33.545009 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Wed Jan 19 12:57:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:57:33.611217 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-0f8e8155-971f-4e25-bd78-0e4cb7afbef4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2", "vcpus": 1, "ram": 1024, "disk": 10}} {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:33.631421 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-0f8e8155-971f-4e25-bd78-0e4cb7afbef4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079545 Jan 19 12:57:33.632155 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Wed Jan 19 12:57:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 12:57:33.643849 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-c2e946f2-d290-423b-8357-e90c57e3e248 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:33.668732 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-c2e946f2-d290-423b-8357-e90c57e3e248 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028248 Jan 19 12:57:33.669346 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Wed Jan 19 12:57:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 12:57:35.933746 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-0f8e8155-971f-4e25-bd78-0e4cb7afbef4 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:57:35.934752 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-0f8e8155-971f-4e25-bd78-0e4cb7afbef4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jan 19 12:57:35.935151 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Wed Jan 19 12:57:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:57:35.994519 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-eb6fa635-2d50-41d9-a3f1-34d5083fe9a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "swap": 0}} {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:36.014730 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-eb6fa635-2d50-41d9-a3f1-34d5083fe9a4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073092 Jan 19 12:57:36.015230 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Wed Jan 19 12:57:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 12:57:36.027153 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-2d4c679d-2df4-493d-a241-005e8c10b444 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:36.050552 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-2d4c679d-2df4-493d-a241-005e8c10b444 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026793 Jan 19 12:57:36.051768 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Wed Jan 19 12:57:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 12:57:38.397457 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-eb6fa635-2d50-41d9-a3f1-34d5083fe9a4 admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:57:38.398474 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-eb6fa635-2d50-41d9-a3f1-34d5083fe9a4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jan 19 12:57:38.398907 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Wed Jan 19 12:57:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 12:57:38.475058 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-430543f8-b47a-4969-b0cc-2a1309477f9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "id": "d4"}} {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:38.496640 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-430543f8-b47a-4969-b0cc-2a1309477f9c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.089135 Jan 19 12:57:38.500343 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Wed Jan 19 12:57:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 12:57:38.510177 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-344a9904-27f5-4967-9b18-fec1078d7de9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:38.537154 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-344a9904-27f5-4967-9b18-fec1078d7de9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031704 Jan 19 12:57:38.537902 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Wed Jan 19 12:57:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 12:57:40.803362 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-430543f8-b47a-4969-b0cc-2a1309477f9c admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:57:40.804474 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-430543f8-b47a-4969-b0cc-2a1309477f9c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jan 19 12:57:40.804882 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Wed Jan 19 12:57:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 12:57:40.865523 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-1d1376a0-5f93-4b73-80d2-96ff35e9d1ce admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:57:40.890790 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-1d1376a0-5f93-4b73-80d2-96ff35e9d1ce admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079886 Jan 19 12:57:40.891355 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Wed Jan 19 12:57:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 12:57:43.148704 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-430543f8-b47a-4969-b0cc-2a1309477f9c admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:57:43.150049 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-430543f8-b47a-4969-b0cc-2a1309477f9c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jan 19 12:57:43.150462 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Wed Jan 19 12:57:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:57:43.220624 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-f8486986-91de-452e-91e9-32b0e2f785e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:43.238057 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-f8486986-91de-452e-91e9-32b0e2f785e0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081851 Jan 19 12:57:43.238895 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Wed Jan 19 12:57:43 2022] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 12:57:43.250146 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-d557bea6-6224-4879-a931-21f21e17e265 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:43.272462 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-d557bea6-6224-4879-a931-21f21e17e265 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025879 Jan 19 12:57:43.273039 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Wed Jan 19 12:57:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 12:57:45.802162 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-f8486986-91de-452e-91e9-32b0e2f785e0 admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:57:45.803170 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-f8486986-91de-452e-91e9-32b0e2f785e0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jan 19 12:57:45.803576 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Wed Jan 19 12:57:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:57:45.862232 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-0b417723-7870-4bed-87a9-c761e193dcef admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small", "swap": 0, "id": "2"}} {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:45.880031 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-0b417723-7870-4bed-87a9-c761e193dcef admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070235 Jan 19 12:57:45.880592 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Wed Jan 19 12:57:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 12:57:45.892336 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-9396a35b-b612-4bc1-b604-3870cdcc2868 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:45.916965 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-9396a35b-b612-4bc1-b604-3870cdcc2868 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028076 Jan 19 12:57:45.917481 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Wed Jan 19 12:57:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 12:57:48.158272 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-0b417723-7870-4bed-87a9-c761e193dcef admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:57:48.159352 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-0b417723-7870-4bed-87a9-c761e193dcef admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Jan 19 12:57:48.159827 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Wed Jan 19 12:57:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:57:48.231178 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-3762f1a9-a6b6-473b-a7aa-37fa26ae4b1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:48.254089 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-3762f1a9-a6b6-473b-a7aa-37fa26ae4b1c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.087987 Jan 19 12:57:48.254819 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Wed Jan 19 12:57:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 12:57:48.271087 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-4aa90982-6adc-41b5-8de5-8019fc663fa9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:48.297983 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-4aa90982-6adc-41b5-8de5-8019fc663fa9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032268 Jan 19 12:57:48.298567 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Wed Jan 19 12:57:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 12:57:50.787539 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-3762f1a9-a6b6-473b-a7aa-37fa26ae4b1c admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:57:50.788539 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-3762f1a9-a6b6-473b-a7aa-37fa26ae4b1c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jan 19 12:57:50.788935 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Wed Jan 19 12:57:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:57:50.847339 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-57a1f0b9-f86d-47ae-9028-b3a784793480 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "id": "4"}} {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:50.865533 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-57a1f0b9-f86d-47ae-9028-b3a784793480 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070104 Jan 19 12:57:50.866080 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Wed Jan 19 12:57:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 12:57:50.878002 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-579253ed-9115-440b-966b-2d8dacd1f3f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:50.901106 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-579253ed-9115-440b-966b-2d8dacd1f3f1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026691 Jan 19 12:57:50.901676 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Wed Jan 19 12:57:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 12:57:53.167208 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-57a1f0b9-f86d-47ae-9028-b3a784793480 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:57:53.168253 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-57a1f0b9-f86d-47ae-9028-b3a784793480 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jan 19 12:57:53.168662 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Wed Jan 19 12:57:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:57:53.231916 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-6873b7ba-b62a-4f21-ac5e-8e090e043f84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:53.250305 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-6873b7ba-b62a-4f21-ac5e-8e090e043f84 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073545 Jan 19 12:57:53.250864 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Wed Jan 19 12:57:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 12:57:53.263651 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-f0eae5f6-3a51-4b7e-ad1c-690ba7b02494 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:57:53.287782 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-f0eae5f6-3a51-4b7e-ad1c-690ba7b02494 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027909 Jan 19 12:57:53.288397 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Wed Jan 19 12:57:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 12:58:18.849450 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-6873b7ba-b62a-4f21-ac5e-8e090e043f84 admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:18.850525 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-6873b7ba-b62a-4f21-ac5e-8e090e043f84 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jan 19 12:58:18.850939 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Wed Jan 19 12:58:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 12:58:18.909194 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-45151c5c-68a2-4b6b-bce3-828a35b62ef4 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:18.926371 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-45151c5c-68a2-4b6b-bce3-828a35b62ef4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068934 Jan 19 12:58:18.926909 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Wed Jan 19 12:58:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 12:58:20.291521 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-6873b7ba-b62a-4f21-ac5e-8e090e043f84 admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:20.292629 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-6873b7ba-b62a-4f21-ac5e-8e090e043f84 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jan 19 12:58:20.293063 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Jan 19 12:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:58:20.484953 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-b0b55fa2-3d8f-4799-ad15-896407418015 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:20.490322 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.wsgi [None req-b0b55fa2-3d8f-4799-ad15-896407418015 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 19 12:58:20.490876 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-b0b55fa2-3d8f-4799-ad15-896407418015 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 12:58:20.491731 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-b0b55fa2-3d8f-4799-ad15-896407418015 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057448 Jan 19 12:58:20.492279 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Wed Jan 19 12:58:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 19 12:58:20.501526 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-3531f804-2025-425f-9699-413fc1cdfa0f admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:20.522508 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-3531f804-2025-425f-9699-413fc1cdfa0f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024566 Jan 19 12:58:20.523667 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Wed Jan 19 12:58:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 12:58:20.533212 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-c7e45111-e01a-432d-b832-6136ed266a2c admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:20.553587 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-c7e45111-e01a-432d-b832-6136ed266a2c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023900 Jan 19 12:58:20.554124 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Wed Jan 19 12:58:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 12:58:20.563446 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-491db50f-1d7a-4f9f-94ea-b522fe62fcd3 admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:20.568847 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.wsgi [None req-491db50f-1d7a-4f9f-94ea-b522fe62fcd3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 19 12:58:20.569413 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-491db50f-1d7a-4f9f-94ea-b522fe62fcd3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 12:58:20.570783 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-491db50f-1d7a-4f9f-94ea-b522fe62fcd3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010990 Jan 19 12:58:20.571268 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Wed Jan 19 12:58:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 19 12:58:21.819241 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-c7e45111-e01a-432d-b832-6136ed266a2c admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:21.820433 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-c7e45111-e01a-432d-b832-6136ed266a2c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Jan 19 12:58:21.820828 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Jan 19 12:58:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:58:22.014892 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-10056ae4-813c-472d-94e2-5e28089c0289 admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:22.020213 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.wsgi [None req-10056ae4-813c-472d-94e2-5e28089c0289 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 19 12:58:22.020774 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-10056ae4-813c-472d-94e2-5e28089c0289 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 12:58:22.021566 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-10056ae4-813c-472d-94e2-5e28089c0289 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058786 Jan 19 12:58:22.022079 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Wed Jan 19 12:58:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 12:58:22.032145 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-3ab61d1b-4d71-402f-8d7f-c3eac717fbb3 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:22.045508 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-3ab61d1b-4d71-402f-8d7f-c3eac717fbb3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016961 Jan 19 12:58:22.046031 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Wed Jan 19 12:58:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 12:58:22.054983 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-5b255149-73d3-4565-a5bf-d273f0d6ec8d admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:22.068087 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-5b255149-73d3-4565-a5bf-d273f0d6ec8d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016469 Jan 19 12:58:22.068614 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Wed Jan 19 12:58:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 12:58:22.078231 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-4bdb342c-c776-44fd-8680-ff8645a02f03 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:22.083346 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.wsgi [None req-4bdb342c-c776-44fd-8680-ff8645a02f03 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 19 12:58:22.083903 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-4bdb342c-c776-44fd-8680-ff8645a02f03 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 12:58:22.084725 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-4bdb342c-c776-44fd-8680-ff8645a02f03 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010043 Jan 19 12:58:22.085826 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Wed Jan 19 12:58:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 12:58:23.466360 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-5b255149-73d3-4565-a5bf-d273f0d6ec8d admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:23.467351 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-5b255149-73d3-4565-a5bf-d273f0d6ec8d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jan 19 12:58:23.467749 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Jan 19 12:58:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:58:23.657629 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-82fa96d7-1693-447b-85b3-f023f1064c1a admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:23.663898 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.wsgi [None req-82fa96d7-1693-447b-85b3-f023f1064c1a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 19 12:58:23.664510 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-82fa96d7-1693-447b-85b3-f023f1064c1a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 12:58:23.665537 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-82fa96d7-1693-447b-85b3-f023f1064c1a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058233 Jan 19 12:58:23.665830 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Wed Jan 19 12:58:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 12:58:23.675126 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-fc1594a0-0db7-4a32-8a75-9d2c58fbd666 admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:23.691087 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-fc1594a0-0db7-4a32-8a75-9d2c58fbd666 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019013 Jan 19 12:58:23.691956 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Wed Jan 19 12:58:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 12:58:23.702286 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-5e30d3db-0b0f-4002-aedc-65de4ca10a20 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:23.715225 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-5e30d3db-0b0f-4002-aedc-65de4ca10a20 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016863 Jan 19 12:58:23.715744 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Wed Jan 19 12:58:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 12:58:23.724632 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-15a172db-a663-440b-9cc1-62dc33b7f8e7 admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:23.730305 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.wsgi [None req-15a172db-a663-440b-9cc1-62dc33b7f8e7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 19 12:58:23.730858 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-15a172db-a663-440b-9cc1-62dc33b7f8e7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 12:58:23.731624 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-15a172db-a663-440b-9cc1-62dc33b7f8e7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010456 Jan 19 12:58:23.732144 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Wed Jan 19 12:58:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 19 12:58:25.001216 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-5e30d3db-0b0f-4002-aedc-65de4ca10a20 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:25.002217 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-5e30d3db-0b0f-4002-aedc-65de4ca10a20 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jan 19 12:58:25.002635 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Jan 19 12:58:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:58:25.201290 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-b3777c68-1dbc-42ec-8310-587164601702 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:58:25.219394 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-b3777c68-1dbc-42ec-8310-587164601702 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070312 Jan 19 12:58:25.219875 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Wed Jan 19 12:58:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 12:58:26.466202 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-5e30d3db-0b0f-4002-aedc-65de4ca10a20 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:26.467203 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-5e30d3db-0b0f-4002-aedc-65de4ca10a20 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jan 19 12:58:26.467609 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Jan 19 12:58:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:58:26.662245 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-fa3d19e2-e35b-451a-a5c1-6c5ec086cd8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:58:26.680262 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-fa3d19e2-e35b-451a-a5c1-6c5ec086cd8a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069765 Jan 19 12:58:26.680731 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Wed Jan 19 12:58:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 12:58:27.970016 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-5e30d3db-0b0f-4002-aedc-65de4ca10a20 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:27.970999 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-5e30d3db-0b0f-4002-aedc-65de4ca10a20 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001389 Jan 19 12:58:27.971395 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Jan 19 12:58:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:58:28.164131 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-c1130637-c4d5-4fab-b6fd-abb5c4a66dcd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:58:28.182478 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-c1130637-c4d5-4fab-b6fd-abb5c4a66dcd admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069574 Jan 19 12:58:28.183025 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Wed Jan 19 12:58:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 12:58:29.439899 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-5e30d3db-0b0f-4002-aedc-65de4ca10a20 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:29.440910 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-5e30d3db-0b0f-4002-aedc-65de4ca10a20 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jan 19 12:58:29.441326 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Jan 19 12:58:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:58:29.636292 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-02ecba55-8fb7-4410-8e63-e4fc10600a6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 12:58:29.654571 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-02ecba55-8fb7-4410-8e63-e4fc10600a6b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070147 Jan 19 12:58:29.655052 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Wed Jan 19 12:58:29 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 12:58:30.941994 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-5e30d3db-0b0f-4002-aedc-65de4ca10a20 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:30.942992 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-5e30d3db-0b0f-4002-aedc-65de4ca10a20 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jan 19 12:58:30.943386 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Jan 19 12:58:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:58:31.135763 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-b4d5b9a3-b7e1-47b6-833d-04aa691358cf admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:58:31.155199 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-b4d5b9a3-b7e1-47b6-833d-04aa691358cf admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070242 Jan 19 12:58:31.155740 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Wed Jan 19 12:58:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 12:59:17.069077 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-5e30d3db-0b0f-4002-aedc-65de4ca10a20 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:59:17.070089 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-5e30d3db-0b0f-4002-aedc-65de4ca10a20 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Jan 19 12:59:17.070496 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Wed Jan 19 12:59:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 12:59:17.128236 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-e0cb3ba5-7597-4ff2-9e4c-106c9596e14b admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:59:17.149431 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-e0cb3ba5-7597-4ff2-9e4c-106c9596e14b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073032 Jan 19 12:59:17.149961 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Wed Jan 19 12:59:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 12:59:17.172695 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-f2004471-5688-4eed-b56b-b5edc7252dd2 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:59:17.181784 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-f2004471-5688-4eed-b56b-b5edc7252dd2 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012600 Jan 19 12:59:17.182321 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Wed Jan 19 12:59:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 12:59:17.193776 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-5415ff11-5fc5-4a8a-bc9d-9c25c45986b0 admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:59:17.203201 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-5415ff11-5fc5-4a8a-bc9d-9c25c45986b0 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013096 Jan 19 12:59:17.203754 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Wed Jan 19 12:59:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 12:59:17.215283 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-dcd43965-69c8-4007-8181-84f4536fabaf admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:59:17.222832 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-dcd43965-69c8-4007-8181-84f4536fabaf admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011065 Jan 19 12:59:17.223353 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Wed Jan 19 12:59:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 12:59:17.234443 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-93895d32-a3b4-44d2-82ac-ad78e707b462 admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 12:59:17.242517 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-93895d32-a3b4-44d2-82ac-ad78e707b462 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011477 Jan 19 12:59:17.243030 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Wed Jan 19 12:59:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:00:47.490058 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-5c7d0e68-affa-48d1-9226-4dde86e2e6eb tempest-verify_tempest_config-1469316087 tempest-verify_tempest_config-1469316087-project] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:00:47.492011 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-5c7d0e68-affa-48d1-9226-4dde86e2e6eb tempest-verify_tempest_config-1469316087 tempest-verify_tempest_config-1469316087-project] 10.222.0.48 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104820 Jan 19 13:00:47.492539 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 34/69] 10.222.0.48 () {58 vars in 1133 bytes} [Wed Jan 19 13:00:47 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:02:16.537569 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-93895d32-a3b4-44d2-82ac-ad78e707b462 admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:02:16.538598 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-93895d32-a3b4-44d2-82ac-ad78e707b462 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002566 Jan 19 13:02:16.538991 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 36/70] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Jan 19 13:02:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:02:16.799515 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-e009d365-9424-4612-8647-3ff782f56eb9 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:02:16.800719 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:02:16.800719 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: warnings.warn(msg) Jan 19 13:02:16.802348 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-e009d365-9424-4612-8647-3ff782f56eb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:02:16.802795 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-e009d365-9424-4612-8647-3ff782f56eb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:02:16.803599 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-e009d365-9424-4612-8647-3ff782f56eb9 admin admin] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:02:16.804054 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-e009d365-9424-4612-8647-3ff782f56eb9 admin admin] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:02:16.839088 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-e009d365-9424-4612-8647-3ff782f56eb9 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150871 Jan 19 13:02:16.839664 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 35/71] 10.222.0.48 () {60 vars in 1193 bytes} [Wed Jan 19 13:02:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:02:18.123823 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-93895d32-a3b4-44d2-82ac-ad78e707b462 admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:02:18.124837 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-93895d32-a3b4-44d2-82ac-ad78e707b462 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jan 19 13:02:18.125234 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 37/72] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Jan 19 13:02:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:02:18.321435 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-d95766d7-8dbe-43c1-af5f-0b0510b62404 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:02:18.322603 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:02:18.322603 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: warnings.warn(msg) Jan 19 13:02:18.324178 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-d95766d7-8dbe-43c1-af5f-0b0510b62404 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:02:18.324620 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-d95766d7-8dbe-43c1-af5f-0b0510b62404 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:02:18.325408 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-d95766d7-8dbe-43c1-af5f-0b0510b62404 admin admin] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:02:18.325834 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-d95766d7-8dbe-43c1-af5f-0b0510b62404 admin admin] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:02:18.345783 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-d95766d7-8dbe-43c1-af5f-0b0510b62404 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076112 Jan 19 13:02:18.346320 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 36/73] 10.222.0.48 () {60 vars in 1193 bytes} [Wed Jan 19 13:02:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:02:30.083062 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-93895d32-a3b4-44d2-82ac-ad78e707b462 admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:02:30.084185 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-93895d32-a3b4-44d2-82ac-ad78e707b462 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jan 19 13:02:30.084582 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 38/74] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Jan 19 13:02:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:02:30.280315 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-0343196e-fd65-4467-9f04-987c60c17ea5 admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:02:30.281523 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:02:30.281523 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: warnings.warn(msg) Jan 19 13:02:30.283059 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-0343196e-fd65-4467-9f04-987c60c17ea5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:02:30.283529 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-0343196e-fd65-4467-9f04-987c60c17ea5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:02:30.284352 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-0343196e-fd65-4467-9f04-987c60c17ea5 admin admin] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:02:30.284778 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-0343196e-fd65-4467-9f04-987c60c17ea5 admin admin] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:02:30.309931 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-0343196e-fd65-4467-9f04-987c60c17ea5 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080497 Jan 19 13:02:30.310476 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 37/75] 10.222.0.48 () {60 vars in 1193 bytes} [Wed Jan 19 13:02:30 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:02:31.591310 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: DEBUG nova.api.openstack.wsgi [None req-93895d32-a3b4-44d2-82ac-ad78e707b462 admin admin] Calling method '>' {{(pid=101954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:02:31.592333 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: INFO nova.api.openstack.requestlog [None req-93895d32-a3b4-44d2-82ac-ad78e707b462 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001392 Jan 19 13:02:31.592732 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: [pid: 101954|app: 0|req: 39/76] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Jan 19 13:02:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:02:31.787897 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG nova.api.openstack.wsgi [None req-61914c01-7469-4cf3-b8cf-8f2b27a519ae admin admin] Calling method '>' {{(pid=101953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:02:31.789131 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:02:31.789131 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: warnings.warn(msg) Jan 19 13:02:31.790700 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-61914c01-7469-4cf3-b8cf-8f2b27a519ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:02:31.791145 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-61914c01-7469-4cf3-b8cf-8f2b27a519ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:02:31.791974 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-61914c01-7469-4cf3-b8cf-8f2b27a519ae admin admin] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:02:31.792422 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: DEBUG oslo_concurrency.lockutils [None req-61914c01-7469-4cf3-b8cf-8f2b27a519ae admin admin] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:02:31.813365 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: INFO nova.api.openstack.requestlog [None req-61914c01-7469-4cf3-b8cf-8f2b27a519ae admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076881 Jan 19 13:02:31.813849 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: [pid: 101953|app: 0|req: 38/77] 10.222.0.48 () {60 vars in 1193 bytes} [Wed Jan 19 13:02:31 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:03:30.471301 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: Wed Jan 19 13:03:30 2022 - graceful shutdown triggered... Jan 19 13:03:30.471415 dv-cinder-823015-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 19 13:03:30.472405 dv-cinder-823015-4-iscsi devstack@n-api.service[101954]: Gracefully killing worker 2 (pid: 101954)... Jan 19 13:03:30.472802 dv-cinder-823015-4-iscsi devstack@n-api.service[101953]: Gracefully killing worker 1 (pid: 101953)... Jan 19 13:03:31.473479 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: worker 1 buried after 1 seconds Jan 19 13:03:31.474087 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: worker 2 buried after 1 seconds Jan 19 13:03:31.474087 dv-cinder-823015-4-iscsi devstack@n-api.service[101952]: goodbye to uWSGI. Jan 19 13:03:31.475042 dv-cinder-823015-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 19 13:03:31.475957 dv-cinder-823015-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 19 13:03:31.478821 dv-cinder-823015-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 19 13:03:31.487781 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 19 13:03:31.490369 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jan 19 13:03:31 2022] *** Jan 19 13:03:31.490523 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 19 13:03:31.490652 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 19 13:03:31.491348 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: nodename: dv-cinder-823015-4-iscsi Jan 19 13:03:31.491456 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: machine: x86_64 Jan 19 13:03:31.491590 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: clock source: unix Jan 19 13:03:31.491810 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: pcre jit disabled Jan 19 13:03:31.491949 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: detected number of CPU cores: 4 Jan 19 13:03:31.492086 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: current working directory: / Jan 19 13:03:31.492195 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: detected binary path: /usr/bin/uwsgi-core Jan 19 13:03:31.492345 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: your processes number limit is 47680 Jan 19 13:03:31.492457 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: your memory page size is 4096 bytes Jan 19 13:03:31.492566 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: detected max file descriptor number: 2048 Jan 19 13:03:31.492696 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: lock engine: pthread robust mutexes Jan 19 13:03:31.492976 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: thunder lock: enabled Jan 19 13:03:31.493285 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 19 13:03:31.493423 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 19 13:03:31.540423 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: Python main interpreter initialized at 0x5573f5b3b9c0 Jan 19 13:03:31.540423 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: python threads support enabled Jan 19 13:03:31.540423 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: your server socket listen backlog is limited to 100 connections Jan 19 13:03:31.540423 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: your mercy for graceful operations on workers is 90 seconds Jan 19 13:03:31.540860 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: mapped 403077 bytes (393 KB) for 2 cores Jan 19 13:03:31.540860 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: *** Operational MODE: preforking *** Jan 19 13:03:31.541165 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: *** uWSGI is running in multiple interpreter mode *** Jan 19 13:03:31.541165 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: spawned uWSGI master process (pid: 116341) Jan 19 13:03:31.541384 dv-cinder-823015-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 19 13:03:31.542080 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: spawned uWSGI worker 1 (pid: 116360, cores: 1) Jan 19 13:03:31.544097 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: spawned uWSGI worker 2 (pid: 116361, cores: 1) Jan 19 13:03:31.544097 dv-cinder-823015-4-iscsi devstack@n-api.service[116341]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 19 13:03:33.501643 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 13:03:33.501643 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: from cryptography.utils import int_from_bytes Jan 19 13:03:33.502361 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 13:03:33.502361 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: from cryptography.utils import int_from_bytes Jan 19 13:03:33.516357 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 13:03:33.516357 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: from cryptography.utils import int_from_bytes Jan 19 13:03:33.517001 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 13:03:33.517001 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: from cryptography.utils import int_from_bytes Jan 19 13:03:35.907531 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 13:03:35.908082 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 13:03:35.908356 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 13:03:35.908676 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 13:03:35.908942 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 13:03:35.909337 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.909671 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.910000 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.910329 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.910665 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.910982 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.911311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.911644 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.912040 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.912265 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.913272 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.913687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-823015-4-iscsi {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.914023 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.914345 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.914665 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.915318 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.915318 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.915613 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.915927 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.916461 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.920108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.920108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.920108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.920108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.920108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.920108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.920108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.920108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.920687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.920687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.920687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-823015-4-iscsi {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.920687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.920957 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.921238 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.921553 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.921829 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.922500 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.922986 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.923486 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.923900 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.924163 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.924499 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.924832 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.925164 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.925479 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.925799 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.926121 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.926453 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.926769 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.927085 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.927343 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.927663 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.928072 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.928378 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.928891 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.929157 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.929417 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.929749 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.930083 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.930403 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.930723 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.931042 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.931359 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.931677 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.932016 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.932340 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.932657 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.932986 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.933312 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.933646 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.933962 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.934290 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.934699 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.934959 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.935276 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.935624 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.935952 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.936295 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.936625 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.936952 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.937270 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.937603 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.937901 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.938231 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.938576 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.938898 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.939156 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.939469 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.939783 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.940138 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.940458 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.940773 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.941089 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.941401 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.941717 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.942033 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.942349 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.942664 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.942979 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.943292 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.943609 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.944105 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.944526 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.944846 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.945184 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.945502 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.945825 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.946141 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.946457 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.946788 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.947105 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.947420 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.947749 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.948090 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.948412 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.948739 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.949066 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.949381 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.949706 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.950235 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.950434 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 13:03:35.950901 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.951091 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 13:03:35.951252 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.951400 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 13:03:35.951544 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.951544 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.951827 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 13:03:35.951827 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 13:03:35.952138 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.952138 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.952426 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.952577 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.952729 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.952880 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.953041 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.953190 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.953340 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.953481 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.953621 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.953767 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.953915 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.954065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.954226 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.954375 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.954516 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.954656 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.954795 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.954958 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.955100 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.955257 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.955407 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.955547 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.955694 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-823015-4-iscsi {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.955847 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.956034 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.956265 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.956420 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.956560 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.956699 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.956856 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.956997 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.957137 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.957288 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.957462 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.957623 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.957792 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.957946 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.958119 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.958415 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.958587 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.958752 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.958893 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.959032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.959171 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.959865 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.960114 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.960280 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.960429 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.960577 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.960728 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.960869 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.961022 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.961164 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.961355 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.961510 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.961687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.961845 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.962002 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.962143 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.962337 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.962491 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-823015-4-iscsi {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.962661 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.962820 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.962991 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.963144 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.963330 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.963487 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.963666 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.963851 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.964028 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.964185 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.964354 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.964509 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.964708 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.964862 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.965035 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.965183 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.965371 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.965527 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.965682 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.965832 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.966015 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.966167 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.966342 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.966488 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.966667 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.966823 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.966992 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.967146 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.967329 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.967481 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.967639 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.967781 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.967965 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.968215 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.968364 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.968513 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.968661 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.968800 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.968948 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.969103 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.969267 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.969997 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.970151 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.970311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.970454 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.970593 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.970739 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.970957 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.971102 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.971243 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.971390 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.971532 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.971692 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.971834 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.972028 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.972180 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.972320 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.972459 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.972612 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.972752 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.972899 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.973046 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.973187 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.973334 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.973486 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.973626 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.973773 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.973929 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.974077 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.974226 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.974374 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.974514 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.974661 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.974808 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.975615 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.975777 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.975920 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.976112 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.976257 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.976403 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.976555 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.976708 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.976708 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.976985 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.977132 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.977280 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.977428 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.977578 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.977725 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.977864 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.978005 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.978151 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.978315 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.978464 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.978604 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.978754 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.978902 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.979042 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.979197 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.979345 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.979486 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.979625 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.979771 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.979918 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.980089 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.980248 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.980390 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.980538 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.980678 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.980818 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.980818 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.981104 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.981256 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.981396 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.981538 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.981690 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.981690 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.981966 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.982129 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.982279 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.982419 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.982559 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.982714 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.982869 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.983010 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.983149 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.983288 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.983435 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.983590 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.983741 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.983881 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.984093 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.984247 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.984394 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.984394 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.984682 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.984823 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.984961 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.985107 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.985254 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.985403 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.985552 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.985700 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.986134 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.986300 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.986449 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.986601 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.986750 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.986905 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.987046 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.987193 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.987343 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.987484 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.987630 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.987779 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.987928 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.988119 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.988269 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.988411 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.988561 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.988711 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.988861 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.989011 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.989151 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.989299 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.989439 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.989593 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.989734 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.989874 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.990024 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.990172 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.990325 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.990475 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.990679 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.990829 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.990978 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.991130 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.991285 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.991433 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.991574 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.991722 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.991873 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.992051 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.992210 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.992352 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.992499 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.992647 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.992790 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.993005 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.993149 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.993296 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.993444 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.993583 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.993723 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.993871 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.994033 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.994175 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.994322 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.994470 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.994639 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.994800 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.994964 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.995119 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.995267 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.995415 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.995586 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.995745 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.995887 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.996071 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.996254 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.996400 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 13:03:35.996576 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.996736 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.996911 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.997057 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.997234 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.997388 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.997565 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.997712 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.997883 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.998040 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.998211 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.998366 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.998549 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.998696 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.998891 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.999045 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.999217 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.999364 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.999540 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.999685 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:35.999864 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.000029 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.000218 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.000380 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.000522 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.000662 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.000845 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.000999 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.001148 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.001301 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.001464 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.001611 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.001785 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.001931 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.002109 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.002265 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.002414 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.002561 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.002735 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.002886 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.003050 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.003206 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.003376 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.003524 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.003696 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.003849 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.004045 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.004216 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.004358 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.004497 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.004638 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.004777 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.004956 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.005103 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.005275 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.005435 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.005605 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.005752 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.005937 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.006084 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.006354 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.006516 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.006698 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.006971 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.007129 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.007278 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.007430 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.007571 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.007712 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.007861 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.008053 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.008203 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.008353 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.008505 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.008687 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.008852 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.009003 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.009143 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.009282 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.009429 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.009609 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.009764 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.009930 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.010085 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.010234 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.010390 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.010560 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.010721 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.011048 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.011376 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.011527 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.011669 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.011818 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.011967 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.012167 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.012311 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.012451 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.012599 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.012768 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.012918 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.013060 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.013206 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.013606 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.013758 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.013907 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.014050 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.014198 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.014346 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.014493 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.014642 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.014798 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.014958 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.015105 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.015254 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.015402 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.015557 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.015705 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.015846 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.016041 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.016199 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.016341 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.016488 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.016630 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.016769 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.016922 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.017062 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.017202 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.017384 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.017576 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.017726 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.017867 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.018013 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.018161 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.018360 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.018515 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.018698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.018854 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.019024 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.019179 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.019329 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.019476 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.019652 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.019806 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.019954 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.020133 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.020284 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.020426 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.020603 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.020750 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.020921 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.021076 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.021225 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.021367 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.021537 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.021692 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.022672 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.022835 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.022978 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.023127 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.023127 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.023417 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.023641 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.023796 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.023937 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.024129 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.024284 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.024436 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.024579 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.024726 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.024875 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.025025 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.025180 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.025321 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.025461 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.025610 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.025760 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.025901 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.026054 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.026194 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.026342 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.026490 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.026631 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.026784 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.026926 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.027065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.027216 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.027363 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.027513 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.027664 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.027806 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.027945 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.028120 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.028270 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.028493 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.028649 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.028799 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.028947 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.029088 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.029228 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.029382 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.029533 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.029674 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.029814 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.030003 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.030148 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.030301 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.030442 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.030624 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.030779 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.030920 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.031059 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.031242 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.031389 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.031562 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.031708 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.031882 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.032083 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.032246 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.032388 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.032527 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.032666 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.032814 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.032955 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.033127 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.033285 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.033434 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.033666 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.033809 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.033960 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.034109 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.034260 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.034410 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.034551 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.034690 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.034839 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.034981 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.035131 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.035279 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.035427 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.035587 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.035738 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.035879 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.036079 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.036239 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.036409 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.036556 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.036744 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.036900 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.037070 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.037226 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.037479 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.038287 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.038458 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.038609 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.038758 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.038900 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.039040 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.039191 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.039377 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.039605 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.039859 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.040029 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.040176 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.040329 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.040482 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.040623 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.040763 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.040902 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.041049 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.041205 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.041346 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.041487 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.041626 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.041772 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.041926 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.042067 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.042215 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.042366 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.042536 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.042683 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.042853 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.042999 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.043167 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.043319 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.043482 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.043628 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.043803 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.043951 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.044170 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.044323 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.044492 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.044635 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.044784 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.044924 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.045070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.045218 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.045358 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.045511 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.045652 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.045791 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.045959 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.046106 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.046273 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.046444 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.046587 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.046726 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.046886 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.047039 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.047238 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.047398 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.047540 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.047688 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.047894 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.048075 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.048220 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.048383 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.048531 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.048680 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.048862 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.049017 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.049166 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.049314 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.049501 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.049646 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.049826 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.049970 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.050140 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.050286 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.050468 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.050622 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.050771 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.050912 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.051096 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.051252 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.051400 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.051548 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.051710 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.051857 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.052095 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.052249 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.052399 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.052553 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.052700 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.052843 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.052995 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.053199 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.053440 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.053688 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.053849 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.054002 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.054151 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.054300 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.054448 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.054598 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.054768 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.054921 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.055069 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.055217 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.055365 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.055507 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.055647 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.055801 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.055944 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.056151 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.056311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.056461 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.056613 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.056799 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.056954 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.057204 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.057403 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.057558 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.057753 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.057900 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.058083 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.058230 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.058418 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.058565 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.058751 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.058914 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.059077 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.059233 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.059375 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.059523 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.059699 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.059957 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.060149 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.060414 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.060662 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.060808 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.061008 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.061155 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.061330 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.061488 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.061665 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.061824 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.061974 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.062121 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.062287 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.062434 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.062606 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.062761 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.062929 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.063082 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.063240 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.063382 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.063553 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.063709 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.063909 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.064128 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.064280 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.064429 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.064579 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.064727 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.064875 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.065023 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.065172 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.065334 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.065483 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.065623 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.065818 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.065964 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.066142 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.066297 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.066461 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.066616 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.066784 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.066938 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.067088 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.067229 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.067445 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.067600 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.067748 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.067901 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.068077 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.068229 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.068397 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.068544 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.069300 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.069460 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.069651 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.069804 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.070008 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.070174 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.070324 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.070682 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.070920 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.071075 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.071239 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.071429 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.071590 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.071749 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.071905 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.072132 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.072287 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.072447 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.072597 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.072747 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.072895 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.073066 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.073219 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.073367 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.073532 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.073681 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.073828 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.074003 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.074156 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.074339 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.074521 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.074669 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.074823 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.074971 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.075117 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.075264 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.075423 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.075578 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.075724 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.075871 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.076039 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.076241 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.076407 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.076573 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.076729 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.076884 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.077032 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.077187 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.077334 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.077490 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.077637 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.077783 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.077936 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.078098 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.078253 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.078400 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.078594 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.078748 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.078895 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.079057 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.079211 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.079358 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.079512 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.079659 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.079813 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.079969 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.080168 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.080317 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.080591 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.080915 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.081085 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.081236 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.081382 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.081536 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.081691 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.081839 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.082062 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.082220 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.082376 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.082531 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.082678 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.082836 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.082992 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.083148 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.083296 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.083442 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.083587 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.083741 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.083896 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.084146 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.084925 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.085147 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.085342 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.085502 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.085661 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.085808 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.085955 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.086103 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.086249 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.086410 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.086568 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.086715 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.086870 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.087016 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.087162 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.087322 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.087479 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.087645 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.087792 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.087939 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.088119 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.088270 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.088416 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.088570 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.088717 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.088863 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.089023 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.089171 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.089316 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.089473 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.089620 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.089768 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.089926 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.090074 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.090228 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.090374 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.090528 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.090699 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.090953 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.091211 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.091371 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.091526 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.091693 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.091848 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.092043 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.092272 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.092423 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.092577 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.092731 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.092891 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.093045 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.093201 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.093348 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.093494 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.093647 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.093815 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.093963 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.094109 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.094262 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.094408 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.094554 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.094712 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.094860 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.095006 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.095159 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.095314 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.095474 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.095629 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.095794 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.095949 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.096133 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.096290 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.096446 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.096610 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.096758 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.096912 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.097067 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.097221 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.097430 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.097588 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.097736 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.097903 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.098063 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.098211 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.098364 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.098510 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.098662 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.098809 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.098969 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.099125 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.099280 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.099434 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.099589 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.099758 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.099974 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.100199 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.100347 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.100502 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.100706 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.100914 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.101136 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.101398 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.101559 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.101707 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.101853 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.102013 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.102183 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.102330 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.102484 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.102640 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.102787 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.102999 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.103151 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.103305 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.103454 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.103607 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.103753 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.103908 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.104080 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.104257 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.104406 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.104552 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.104706 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.104972 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.105128 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.105299 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.105460 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.105617 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.105771 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.105924 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.106079 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.106244 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.106400 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.106560 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.106724 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.106881 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.107035 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.107190 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.107337 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.107483 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.107714 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.107883 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.108098 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.108253 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.108479 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.109025 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.109195 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.109345 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.109493 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.109655 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.109812 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.109812 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.110245 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.110245 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.110537 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.110687 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.110853 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.110853 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.111151 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.111151 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.111617 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.111780 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.111938 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.112118 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.112118 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.112400 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.112548 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.112703 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.112879 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.113028 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.113174 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.113327 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.113475 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.113624 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.113779 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.113939 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.114095 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.114255 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.114403 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.114559 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.114708 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.114874 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.115022 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.115169 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.115324 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.115481 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.115631 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.115961 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.116207 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.116430 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.116757 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.116907 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.117195 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.117324 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.117525 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.117866 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.118012 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.118211 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.118533 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.118699 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.118851 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.119173 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.119316 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.119492 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.119716 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.119846 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.120161 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.120304 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.120483 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.120758 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.120906 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.121123 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.121278 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.121491 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.121754 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.121903 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.122066 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.122280 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.122419 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.122704 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.122840 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.123041 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.123230 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.123368 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.123690 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.123827 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.124839 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.125005 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.125151 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.125151 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.125400 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.125539 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.125666 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.125791 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.125791 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.126035 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.126172 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.126311 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.126436 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.126568 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.126885 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.127020 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.127229 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.127370 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.127574 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.127899 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.128146 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.128291 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.128607 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.128736 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.128939 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.129169 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.129298 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.129599 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.129738 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.129918 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.130150 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.130280 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.130552 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.130681 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.130876 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.131104 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.132068 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.132068 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.132423 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.132572 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.132700 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.132833 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.132960 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.133092 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.133268 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.133552 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.133695 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.133907 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.134042 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.134457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.134600 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.134752 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.134962 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.135184 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.135315 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.135472 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.135651 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.135827 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.136146 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.136293 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.136504 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.136633 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.136838 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.137087 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.137225 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.137505 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.137633 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.137832 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.138098 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.138250 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.138757 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.138967 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.139106 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.139406 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.139543 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.139739 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.140100 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.140253 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.140431 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.140688 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.140818 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.141076 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.141212 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.141407 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.141676 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.141816 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.142119 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.142258 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.142561 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.142689 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.142956 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.143093 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.143284 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.143494 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.143631 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.143921 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.144082 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.144290 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.144697 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.144843 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.144970 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.145252 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.145408 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.145537 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.145669 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.145849 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.146131 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.146262 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.146513 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.146643 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.146933 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.147231 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.147368 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.147612 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.147751 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.147944 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.148133 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.148301 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.148597 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.148735 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.148991 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.149122 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.149320 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.149643 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.149972 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.150306 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.150435 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.150634 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.150816 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.150946 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.151281 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.151418 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.151612 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.151846 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.152007 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.152300 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.152451 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.152617 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.152946 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.153114 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.153277 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.153618 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.153822 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.153952 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.154217 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.154380 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.154770 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.154914 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.155050 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.155289 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.155562 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.155770 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.156036 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.156188 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.156464 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.156593 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.156806 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.156985 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.157146 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.157451 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.157590 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.157797 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.157957 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.158141 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.158463 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.158693 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.158824 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.159095 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.159223 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.159419 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.159642 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.159781 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.160092 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.160236 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.160421 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.160628 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.160766 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.161068 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.161197 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.161396 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.161569 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.161943 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.162087 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.162310 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.163083 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.163225 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.163564 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.163694 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.163966 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.164166 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.164322 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.164563 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.164965 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.164965 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.165263 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.165402 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.165628 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.165766 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.165900 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.166217 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.166348 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.166534 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.166722 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.166852 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.167166 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.167308 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.167492 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.167872 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.168037 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.168192 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.168329 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.168466 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.169640 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.169800 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.169800 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.169800 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.169800 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.170315 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.170444 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.170444 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.170944 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.171087 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.171087 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.171365 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.171498 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.171775 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.171919 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.172070 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.172212 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.172360 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.172586 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.172726 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.172900 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.173194 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.173344 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.173528 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.173801 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.173934 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.174206 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.174348 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.174486 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.175068 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.175228 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.175228 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.175489 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.176211 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.176211 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.176489 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.176620 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.176757 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.176885 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.176885 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.177293 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.177434 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.177573 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.177712 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.178714 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.178968 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.179242 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.179457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.179798 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.179955 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.180279 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.180396 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.180507 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.180626 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.180958 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.181161 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.181299 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.181633 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.181822 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.182054 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.182393 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.182555 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.182775 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.183913 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.184158 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.184327 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.184467 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.184672 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.184794 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.184794 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.184794 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.185644 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.185798 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.185916 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.186083 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.186401 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.186545 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.186682 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.186817 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.186953 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.187083 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.187219 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.187387 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.187549 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.187685 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.187813 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.187939 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.188092 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.188229 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.188229 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.188535 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.188665 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.188791 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.188958 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.189096 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.189224 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.189351 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.189520 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.189686 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.189823 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.189957 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.190092 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.190226 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.190361 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.190492 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.190619 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.190777 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.190905 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.191059 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.191197 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.191401 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.191560 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.191732 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.191879 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.192076 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.192219 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.192431 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.192576 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.192831 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.192970 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.193097 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.193232 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.193411 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.193542 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.194601 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.194830 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.195028 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.195187 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.195632 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.196043 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.196043 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.196680 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.196835 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.197029 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.197181 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.197315 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.197470 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.197627 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.197790 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.197790 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.198053 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.198179 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.198560 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.198760 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.199010 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.199197 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.199415 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.199549 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.199869 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.200065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.200380 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.200601 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.200735 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.200986 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.201128 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.201311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 13:03:36.201508 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.202017 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.202348 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.202707 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.203013 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.203341 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.203669 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.204032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.204384 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.204708 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.205044 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.205384 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.205734 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.206029 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.206407 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.206783 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.207135 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.207467 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.207793 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.208147 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.208483 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.208813 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.209158 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.209583 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.209928 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.210272 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.210639 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.210970 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.211352 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.211677 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.213269 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.213642 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.213984 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 13:03:36.214254 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 13:03:36.226078 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_db.sqlalchemy.engines [None req-584a43ba-704c-4b09-9d76-d3e269620984 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 13:03:36.237679 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_db.sqlalchemy.engines [None req-304d86dc-ea73-4b8c-89eb-09cc4bcd249f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 13:03:36.294482 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.context [None req-584a43ba-704c-4b09-9d76-d3e269620984 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f40e5328-425f-45ad-99cf-718290ac762d(cell1) {{(pid=116360) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 13:03:36.298771 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-584a43ba-704c-4b09-9d76-d3e269620984 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:03:36.300457 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-584a43ba-704c-4b09-9d76-d3e269620984 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:03:36.301297 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-584a43ba-704c-4b09-9d76-d3e269620984 None None] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:03:36.303864 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-584a43ba-704c-4b09-9d76-d3e269620984 None None] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:03:36.305468 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.context [None req-304d86dc-ea73-4b8c-89eb-09cc4bcd249f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f40e5328-425f-45ad-99cf-718290ac762d(cell1) {{(pid=116361) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 13:03:36.309765 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-304d86dc-ea73-4b8c-89eb-09cc4bcd249f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:03:36.311419 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-304d86dc-ea73-4b8c-89eb-09cc4bcd249f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:03:36.312285 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-304d86dc-ea73-4b8c-89eb-09cc4bcd249f None None] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:03:36.314296 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-304d86dc-ea73-4b8c-89eb-09cc4bcd249f None None] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:03:36.315132 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_db.sqlalchemy.engines [None req-584a43ba-704c-4b09-9d76-d3e269620984 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 13:03:36.316365 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_db.sqlalchemy.engines [None req-584a43ba-704c-4b09-9d76-d3e269620984 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 13:03:36.325350 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_db.sqlalchemy.engines [None req-304d86dc-ea73-4b8c-89eb-09cc4bcd249f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 13:03:36.326217 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_db.sqlalchemy.engines [None req-304d86dc-ea73-4b8c-89eb-09cc4bcd249f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 13:03:36.483191 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_db.sqlalchemy.engines [None req-584a43ba-704c-4b09-9d76-d3e269620984 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 13:03:36.491548 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_db.sqlalchemy.engines [None req-304d86dc-ea73-4b8c-89eb-09cc4bcd249f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 13:03:36.822383 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: WARNING keystonemiddleware.auth_token [None req-304d86dc-ea73-4b8c-89eb-09cc4bcd249f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 13:03:36.826165 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: WARNING keystonemiddleware.auth_token [None req-584a43ba-704c-4b09-9d76-d3e269620984 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 13:03:36.829141 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: WARNING keystonemiddleware.auth_token [None req-304d86dc-ea73-4b8c-89eb-09cc4bcd249f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 13:03:36.833014 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: WARNING keystonemiddleware.auth_token [None req-584a43ba-704c-4b09-9d76-d3e269620984 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 13:03:37.185943 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: WARNING keystonemiddleware.auth_token [None req-304d86dc-ea73-4b8c-89eb-09cc4bcd249f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 13:03:37.191325 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: WARNING keystonemiddleware.auth_token [None req-304d86dc-ea73-4b8c-89eb-09cc4bcd249f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 13:03:37.197069 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: WARNING keystonemiddleware.auth_token [None req-584a43ba-704c-4b09-9d76-d3e269620984 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 13:03:37.197764 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573f5b3b9c0 pid: 116361 (default app) Jan 19 13:03:37.203198 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: WARNING keystonemiddleware.auth_token [None req-584a43ba-704c-4b09-9d76-d3e269620984 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 13:03:37.208747 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573f5b3b9c0 pid: 116360 (default app) Jan 19 13:04:15.492821 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d48bd0ba-5456-42b3-84e0-546e483b0239 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] Calling method '.version_select at 0x7f07e5b71af0>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:15.764462 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2091779025", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452", "networks": [{"uuid": "d84d1b1c-2bab-4497-9c05-65b3834ab66e"}]}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:04:16.386788 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d48bd0ba-5456-42b3-84e0-546e483b0239 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/872acc82-b743-43a4-9952-9faee0568180" status: 200 len: 350 microversion: 2.1 time: 1.341470 Jan 19 13:04:16.387387 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 1/1] 10.222.0.48 () {58 vars in 1244 bytes} [Wed Jan 19 13:04:15 2022] GET /compute/v2.1/os-volumes/872acc82-b743-43a4-9952-9faee0568180 => generated 350 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:04:17.187321 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.network.neutron [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] validate_networks() for [('d84d1b1c-2bab-4497-9c05-65b3834ab66e', None, None, None, None, None)] {{(pid=116361) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:04:18.214645 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7b0444a0-8669-4109-a229-02d4335c8777 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] Calling method '.version_select at 0x7f07e5a3a940>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:18.348373 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7b0444a0-8669-4109-a229-02d4335c8777 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/94535fe0-a471-4fe0-b959-1a32cf8e64ac" status: 200 len: 350 microversion: 2.1 time: 0.143452 Jan 19 13:04:18.348941 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 2/2] 10.222.0.48 () {58 vars in 1244 bytes} [Wed Jan 19 13:04:18 2022] GET /compute/v2.1/os-volumes/94535fe0-a471-4fe0-b959-1a32cf8e64ac => generated 350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:04:19.259062 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Flavor limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:04:19.259565 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Image limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:04:19.259950 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Flavor pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:04:19.260745 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Image pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:04:19.261920 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:04:19.295688 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:19.296183 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:19.299851 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:19.300386 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:19.377944 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Getting quotas for project 42e7f65164ce40a1837e0dac2835a435. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:04:19.389802 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Getting quotas for user 1f649e26f7b642eea3047edbcdc5f4bc and project 42e7f65164ce40a1837e0dac2835a435. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:04:19.407999 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Going to run 1 instances... {{(pid=116361) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:04:19.412257 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:04:19.542805 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a4bdd317-71d7-483f-b071-8f3ddc7435ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.117719 Jan 19 13:04:19.549000 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:04:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 5125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:04:19.554098 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7e594b6b-8c0b-4938-8854-a0d61b0640c8 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:19.554838 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7e594b6b-8c0b-4938-8854-a0d61b0640c8 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:20.019400 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7e594b6b-8c0b-4938-8854-a0d61b0640c8 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:20.051736 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7e594b6b-8c0b-4938-8854-a0d61b0640c8 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1215 microversion: 2.1 time: 0.501666 Jan 19 13:04:20.052463 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:19 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1215 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:21.076612 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e7a05afc-ee42-4cf1-8272-9b391b8d6664 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:21.077241 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e7a05afc-ee42-4cf1-8272-9b391b8d6664 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:21.366630 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e7a05afc-ee42-4cf1-8272-9b391b8d6664 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:21.414274 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e7a05afc-ee42-4cf1-8272-9b391b8d6664 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1215 microversion: 2.1 time: 0.341453 Jan 19 13:04:21.431540 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 2/5] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:21 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1215 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:22.440548 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-300ad7d1-3a15-4b9c-85a7-fad638c883cf tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:22.442352 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-300ad7d1-3a15-4b9c-85a7-fad638c883cf tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:22.464552 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-300ad7d1-3a15-4b9c-85a7-fad638c883cf tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:22.465320 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-300ad7d1-3a15-4b9c-85a7-fad638c883cf tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:22.466966 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-300ad7d1-3a15-4b9c-85a7-fad638c883cf tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:22.468559 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-300ad7d1-3a15-4b9c-85a7-fad638c883cf tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:22.919851 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-300ad7d1-3a15-4b9c-85a7-fad638c883cf tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:22.937972 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-300ad7d1-3a15-4b9c-85a7-fad638c883cf tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1219 microversion: 2.1 time: 0.506322 Jan 19 13:04:22.942945 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 4/6] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:22 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1219 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:23.414854 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c46d4a58-837f-463c-b89d-23cc963e76f2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'create', calling method: .version_select at 0x7f07e514a4c0>, body: {"keypair": {"name": "tempest-keypair-1617687012"}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:04:23.457764 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-c46d4a58-837f-463c-b89d-23cc963e76f2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Getting quotas for project 2c0e1420e5d740a89a0d8b78be696f12. Resources: {'key_pairs'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:04:23.465931 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-c46d4a58-837f-463c-b89d-23cc963e76f2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Getting quotas for user 4d4c420e958c47fc9a36e1602e5a2d86 and project 2c0e1420e5d740a89a0d8b78be696f12. Resources: {'key_pairs'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:04:23.748214 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-c46d4a58-837f-463c-b89d-23cc963e76f2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Getting quotas for project 2c0e1420e5d740a89a0d8b78be696f12. Resources: {'key_pairs'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:04:23.752798 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-c46d4a58-837f-463c-b89d-23cc963e76f2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Getting quotas for user 4d4c420e958c47fc9a36e1602e5a2d86 and project 2c0e1420e5d740a89a0d8b78be696f12. Resources: {'key_pairs'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:04:23.778420 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c46d4a58-837f-463c-b89d-23cc963e76f2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.856823 Jan 19 13:04:23.779059 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 3/7] 10.222.0.48 () {60 vars in 1157 bytes} [Wed Jan 19 13:04:22 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:23.966496 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-acd49ed7-4c27-40f3-b3d5-3d440ac50c9c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:23.967041 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-acd49ed7-4c27-40f3-b3d5-3d440ac50c9c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:23.985574 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-acd49ed7-4c27-40f3-b3d5-3d440ac50c9c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:23.986039 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-acd49ed7-4c27-40f3-b3d5-3d440ac50c9c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:23.986868 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-acd49ed7-4c27-40f3-b3d5-3d440ac50c9c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:23.987309 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-acd49ed7-4c27-40f3-b3d5-3d440ac50c9c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:24.328030 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-acd49ed7-4c27-40f3-b3d5-3d440ac50c9c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:24.345662 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-acd49ed7-4c27-40f3-b3d5-3d440ac50c9c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1219 microversion: 2.1 time: 0.389573 Jan 19 13:04:24.361392 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:23 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1219 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:25.397168 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ca2945b7-ce64-4c8f-9ace-980f69e64b37 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:25.397753 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ca2945b7-ce64-4c8f-9ace-980f69e64b37 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:25.407577 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ca2945b7-ce64-4c8f-9ace-980f69e64b37 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:25.409898 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ca2945b7-ce64-4c8f-9ace-980f69e64b37 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:25.411393 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ca2945b7-ce64-4c8f-9ace-980f69e64b37 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:25.412120 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ca2945b7-ce64-4c8f-9ace-980f69e64b37 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:25.605122 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ca2945b7-ce64-4c8f-9ace-980f69e64b37 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:25.624934 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ca2945b7-ce64-4c8f-9ace-980f69e64b37 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1275 microversion: 2.1 time: 0.262562 Jan 19 13:04:25.626680 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 4/9] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:25 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1275 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:26.133001 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-18cc24a9-a416-430d-9c36-009437da3aa0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'create', calling method: .version_select at 0x7f07e59403a0>, body: {"keypair": {"name": "tempest-keypair-1470167233"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:04:26.261113 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-18cc24a9-a416-430d-9c36-009437da3aa0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Getting quotas for project efc6dbc546054e459498f200e327e75e. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:04:26.279466 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-18cc24a9-a416-430d-9c36-009437da3aa0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Getting quotas for user 10527eff7ddc473396e1ce848c39c7e9 and project efc6dbc546054e459498f200e327e75e. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:04:26.279782 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1681280382", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5e16bdef-82fd-4cf0-81f4-de1c14af2db5"}]}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:04:26.430720 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.network.neutron [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] validate_networks() for [('5e16bdef-82fd-4cf0-81f4-de1c14af2db5', None, None, None, None, None)] {{(pid=116361) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:04:27.022594 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-18cc24a9-a416-430d-9c36-009437da3aa0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Getting quotas for project efc6dbc546054e459498f200e327e75e. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:04:27.045821 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-18cc24a9-a416-430d-9c36-009437da3aa0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Getting quotas for user 10527eff7ddc473396e1ce848c39c7e9 and project efc6dbc546054e459498f200e327e75e. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:04:27.086741 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-18cc24a9-a416-430d-9c36-009437da3aa0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.413715 Jan 19 13:04:27.089810 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 6/10] 10.222.0.48 () {62 vars in 1198 bytes} [Wed Jan 19 13:04:25 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1419 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 19 13:04:27.110694 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-48c1aa81-7e06-43b1-a461-b45e9f62b8b9 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] Calling method '.version_select at 0x7f07e586b430>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:27.296627 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-48c1aa81-7e06-43b1-a461-b45e9f62b8b9 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f5cdb00c-1412-4395-85b3-32cc41d34556" status: 200 len: 351 microversion: 2.1 time: 0.203628 Jan 19 13:04:27.298219 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 7/11] 10.222.0.48 () {58 vars in 1244 bytes} [Wed Jan 19 13:04:27 2022] GET /compute/v2.1/os-volumes/f5cdb00c-1412-4395-85b3-32cc41d34556 => generated 351 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:04:27.310442 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c0c7334b-d472-46e6-a752-9391b589f05e tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:27.311147 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c0c7334b-d472-46e6-a752-9391b589f05e tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:27.336060 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c0c7334b-d472-46e6-a752-9391b589f05e tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:27.340881 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c0c7334b-d472-46e6-a752-9391b589f05e tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:27.344291 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c0c7334b-d472-46e6-a752-9391b589f05e tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:27.344752 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c0c7334b-d472-46e6-a752-9391b589f05e tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:27.512292 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c0c7334b-d472-46e6-a752-9391b589f05e tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:27.525223 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c0c7334b-d472-46e6-a752-9391b589f05e tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1273 microversion: 2.1 time: 0.225701 Jan 19 13:04:27.528280 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 8/12] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:27 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1273 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:27.555325 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a317545f-a361-46c0-856e-5845656a8810 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] Calling method '.version_select at 0x7f07e5026790>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:27.618451 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Flavor limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:04:27.620273 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Image limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:04:27.621519 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Flavor pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:04:27.622426 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Image pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:04:27.623480 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:04:27.637380 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:27.638605 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:27.639641 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:27.640444 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:27.668267 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Getting quotas for project 2a46b7542c5e47579c80a7d0fd01e00d. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:04:27.673238 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Getting quotas for user 01d05bff640440a1a71fc35306e96858 and project 2a46b7542c5e47579c80a7d0fd01e00d. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:04:27.689447 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Going to run 1 instances... {{(pid=116361) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:04:27.694080 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:04:27.777480 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e0936aaa-307f-4ddf-a34e-c421882caa67 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.617648 Jan 19 13:04:27.778283 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 5/13] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:04:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:04:27.790163 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b3becba4-c3c9-4039-989e-14e51b85aff1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:27.791709 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b3becba4-c3c9-4039-989e-14e51b85aff1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:27.815633 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a317545f-a361-46c0-856e-5845656a8810 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.285115 Jan 19 13:04:27.816741 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 9/14] 10.222.0.48 () {58 vars in 1133 bytes} [Wed Jan 19 13:04:27 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:27.830665 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-220b7374-0772-46a0-9afa-b6622bb61323 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] Calling method '.version_select at 0x7f07e5032b80>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:27.912352 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b3becba4-c3c9-4039-989e-14e51b85aff1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:27.924516 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b3becba4-c3c9-4039-989e-14e51b85aff1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1222 microversion: 2.1 time: 0.138412 Jan 19 13:04:27.944499 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 6/15] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:27 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1222 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:28.035202 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2103872916", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5e16bdef-82fd-4cf0-81f4-de1c14af2db5"}]}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:04:28.210999 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-220b7374-0772-46a0-9afa-b6622bb61323 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.384312 Jan 19 13:04:28.211771 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 10/16] 10.222.0.48 () {58 vars in 1148 bytes} [Wed Jan 19 13:04:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:04:28.227471 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3cf1616b-1f1a-44c4-8213-8507bbdfd25f tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] Calling method '.version_select at 0x7f07e5032a60>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:28.230280 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.network.neutron [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] validate_networks() for [('5e16bdef-82fd-4cf0-81f4-de1c14af2db5', None, None, None, None, None)] {{(pid=116361) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:04:28.541158 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3cf1616b-1f1a-44c4-8213-8507bbdfd25f tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.318701 Jan 19 13:04:28.542113 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 11/17] 10.222.0.48 () {58 vars in 1133 bytes} [Wed Jan 19 13:04:28 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:28.561391 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7396fa15-7d45-4f42-a8f8-419bb9ca9e4c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:28.566284 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7396fa15-7d45-4f42-a8f8-419bb9ca9e4c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:28.576448 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7396fa15-7d45-4f42-a8f8-419bb9ca9e4c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:28.581921 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7396fa15-7d45-4f42-a8f8-419bb9ca9e4c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:28.583363 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7396fa15-7d45-4f42-a8f8-419bb9ca9e4c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:28.584166 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7396fa15-7d45-4f42-a8f8-419bb9ca9e4c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:28.784333 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7396fa15-7d45-4f42-a8f8-419bb9ca9e4c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:28.794556 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7396fa15-7d45-4f42-a8f8-419bb9ca9e4c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1273 microversion: 2.1 time: 0.250888 Jan 19 13:04:28.808057 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 12/18] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:28 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:28.825807 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-42033b2f-37a7-48f5-a537-ba26184ff151 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] Calling method '.version_select at 0x7f07e6390550>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:29.128116 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-42033b2f-37a7-48f5-a537-ba26184ff151 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.318420 Jan 19 13:04:29.128831 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 13/19] 10.222.0.48 () {58 vars in 1166 bytes} [Wed Jan 19 13:04:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:04:29.144021 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d27defb1-1118-4a00-b920-f3c3d6587544 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] Calling method '.version_select at 0x7f07e50263a0>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:29.401012 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d27defb1-1118-4a00-b920-f3c3d6587544 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.261162 Jan 19 13:04:29.410352 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 14/20] 10.222.0.48 () {58 vars in 1169 bytes} [Wed Jan 19 13:04:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:04:29.421670 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9b496a68-daee-4980-8939-dcd6d690cef4 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] Calling method '.version_select at 0x7f07e50290d0>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:29.608032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Flavor limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:04:29.608616 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Image limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:04:29.610150 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Flavor pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:04:29.610947 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Image pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:04:29.611556 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:04:29.636853 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:29.638600 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:29.640684 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:29.641148 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:29.683733 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Getting quotas for project 2a46b7542c5e47579c80a7d0fd01e00d. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:04:29.688776 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Getting quotas for user 01d05bff640440a1a71fc35306e96858 and project 2a46b7542c5e47579c80a7d0fd01e00d. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:04:29.703664 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Going to run 1 instances... {{(pid=116361) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:04:29.705995 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:04:29.722512 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9b496a68-daee-4980-8939-dcd6d690cef4 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.309135 Jan 19 13:04:29.724848 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 15/21] 10.222.0.48 () {58 vars in 1154 bytes} [Wed Jan 19 13:04:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:29.735713 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-41afdc59-d225-487b-933a-6cf0c53d1e94 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] Calling method '.version_select at 0x7f07e5930d30>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:29.789517 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3b83a963-f28d-418c-8cbb-ef239790f8d4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.761676 Jan 19 13:04:29.802433 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 7/22] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:04:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 19 13:04:29.819186 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-24b62f7c-779a-4d9c-af5d-531f4e16b5ec tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:29.824229 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-24b62f7c-779a-4d9c-af5d-531f4e16b5ec tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:30.147446 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-24b62f7c-779a-4d9c-af5d-531f4e16b5ec tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:30.147775 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-41afdc59-d225-487b-933a-6cf0c53d1e94 tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.415735 Jan 19 13:04:30.148494 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 16/23] 10.222.0.48 () {58 vars in 1187 bytes} [Wed Jan 19 13:04:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:04:30.154906 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-56b2d875-4f08-4b62-b9eb-b8f33d40917f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:30.155730 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-56b2d875-4f08-4b62-b9eb-b8f33d40917f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:30.169015 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-24b62f7c-779a-4d9c-af5d-531f4e16b5ec tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1222 microversion: 2.1 time: 0.365413 Jan 19 13:04:30.172207 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 8/24] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:29 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1222 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:30.186860 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-56b2d875-4f08-4b62-b9eb-b8f33d40917f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:30.188430 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-56b2d875-4f08-4b62-b9eb-b8f33d40917f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:30.190077 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-04f4e0c2-004a-451f-a96c-61d95f24dd4a tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] Calling method '.version_select at 0x7f07e405a040>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:30.190593 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-56b2d875-4f08-4b62-b9eb-b8f33d40917f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:30.192184 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-56b2d875-4f08-4b62-b9eb-b8f33d40917f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:30.541369 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-04f4e0c2-004a-451f-a96c-61d95f24dd4a tempest-VolumesTestJSON-1552513016 tempest-VolumesTestJSON-1552513016-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.367026 Jan 19 13:04:30.542448 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 9/25] 10.222.0.48 () {58 vars in 1154 bytes} [Wed Jan 19 13:04:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:30.547739 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-98587713", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae8f130f-fa73-4a66-ba7c-798b3f475e09"}], "security_groups": [{"name": "tempest-securitygroup--952014516"}], "key_name": "tempest-keypair-1617687012", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:04:30.985077 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.network.neutron [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] validate_networks() for [('ae8f130f-fa73-4a66-ba7c-798b3f475e09', None, None, None, None, None)] {{(pid=116361) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:04:30.995599 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-56b2d875-4f08-4b62-b9eb-b8f33d40917f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:31.003273 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-56b2d875-4f08-4b62-b9eb-b8f33d40917f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.853688 Jan 19 13:04:31.013438 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 17/26] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:30 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:31.198492 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6faa99da-29d0-4448-b9ba-cee4122c07d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:31.200346 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6faa99da-29d0-4448-b9ba-cee4122c07d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:31.216704 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6faa99da-29d0-4448-b9ba-cee4122c07d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:31.218668 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6faa99da-29d0-4448-b9ba-cee4122c07d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:31.221889 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6faa99da-29d0-4448-b9ba-cee4122c07d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:31.225239 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6faa99da-29d0-4448-b9ba-cee4122c07d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:31.436232 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6faa99da-29d0-4448-b9ba-cee4122c07d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:31.449277 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6faa99da-29d0-4448-b9ba-cee4122c07d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1226 microversion: 2.1 time: 0.260466 Jan 19 13:04:31.449997 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 18/27] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:31 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1226 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:31.844850 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Flavor limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:04:31.845301 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Image limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:04:31.846024 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Flavor pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:04:31.846439 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Image pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:04:31.846848 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:04:31.858138 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:31.867595 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:31.868686 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:31.869275 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:31.962857 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Getting quotas for project 2c0e1420e5d740a89a0d8b78be696f12. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:04:31.984779 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Getting quotas for user 4d4c420e958c47fc9a36e1602e5a2d86 and project 2c0e1420e5d740a89a0d8b78be696f12. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:04:32.011028 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Going to run 1 instances... {{(pid=116361) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:04:32.013523 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:04:32.029637 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ba403d5c-cc07-40c5-a9a3-f9ac0dd6e905 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:32.033026 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ba403d5c-cc07-40c5-a9a3-f9ac0dd6e905 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:32.044121 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ba403d5c-cc07-40c5-a9a3-f9ac0dd6e905 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:32.045409 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ba403d5c-cc07-40c5-a9a3-f9ac0dd6e905 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:32.046720 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ba403d5c-cc07-40c5-a9a3-f9ac0dd6e905 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:32.047370 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ba403d5c-cc07-40c5-a9a3-f9ac0dd6e905 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:32.074433 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b7d5eb31-086d-4bab-8cc6-61237f3e83af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.530668 Jan 19 13:04:32.085342 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 10/28] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:04:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:04:32.095287 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-582d495d-2c1f-479b-90c8-ad9668291b24 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:32.096341 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-582d495d-2c1f-479b-90c8-ad9668291b24 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:32.309631 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-582d495d-2c1f-479b-90c8-ad9668291b24 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:32.322503 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-582d495d-2c1f-479b-90c8-ad9668291b24 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1236 microversion: 2.1 time: 0.231408 Jan 19 13:04:32.326300 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 11/29] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:32 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1236 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:32.420911 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ba403d5c-cc07-40c5-a9a3-f9ac0dd6e905 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:32.430360 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ba403d5c-cc07-40c5-a9a3-f9ac0dd6e905 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.412224 Jan 19 13:04:32.431778 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 19/30] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:32 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:32.466978 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-dc74e9e7-506e-4b90-b6dd-aff1d277c5e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:32.468054 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-dc74e9e7-506e-4b90-b6dd-aff1d277c5e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:32.489727 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dc74e9e7-506e-4b90-b6dd-aff1d277c5e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:32.496537 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dc74e9e7-506e-4b90-b6dd-aff1d277c5e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:32.498535 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dc74e9e7-506e-4b90-b6dd-aff1d277c5e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:32.499174 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dc74e9e7-506e-4b90-b6dd-aff1d277c5e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:32.582205 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-dc74e9e7-506e-4b90-b6dd-aff1d277c5e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:32.604411 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1432291104", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c97970eb-1cd7-4b38-8fa2-dc9eda10cae4"}], "security_groups": [{"name": "tempest-securitygroup--187505078"}], "key_name": "tempest-keypair-1470167233", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:04:32.611009 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-dc74e9e7-506e-4b90-b6dd-aff1d277c5e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1226 microversion: 2.1 time: 0.146701 Jan 19 13:04:32.620457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 12/31] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:32 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1226 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:32.850221 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.network.neutron [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] validate_networks() for [('c97970eb-1cd7-4b38-8fa2-dc9eda10cae4', None, None, None, None, None)] {{(pid=116360) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:04:33.344459 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-43f37256-cd5c-4eab-a1dc-f626b0aaa776 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:33.346215 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-43f37256-cd5c-4eab-a1dc-f626b0aaa776 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:33.357082 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-43f37256-cd5c-4eab-a1dc-f626b0aaa776 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:33.358902 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-43f37256-cd5c-4eab-a1dc-f626b0aaa776 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:33.360435 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-43f37256-cd5c-4eab-a1dc-f626b0aaa776 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:33.361941 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-43f37256-cd5c-4eab-a1dc-f626b0aaa776 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:33.442349 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-43f37256-cd5c-4eab-a1dc-f626b0aaa776 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:33.453455 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-43f37256-cd5c-4eab-a1dc-f626b0aaa776 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1240 microversion: 2.1 time: 0.112970 Jan 19 13:04:33.464150 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 13/32] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:33 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1240 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:33.471568 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-10ddd7de-0c16-4f08-903c-b1b26a2d2523 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:33.473542 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-10ddd7de-0c16-4f08-903c-b1b26a2d2523 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:33.510918 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-10ddd7de-0c16-4f08-903c-b1b26a2d2523 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:33.511378 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-10ddd7de-0c16-4f08-903c-b1b26a2d2523 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:33.512217 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-10ddd7de-0c16-4f08-903c-b1b26a2d2523 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:33.516921 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-10ddd7de-0c16-4f08-903c-b1b26a2d2523 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:33.899305 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-10ddd7de-0c16-4f08-903c-b1b26a2d2523 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:33.924465 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-10ddd7de-0c16-4f08-903c-b1b26a2d2523 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.459090 Jan 19 13:04:33.925059 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 14/33] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:33 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:33.935520 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-37157e63-b6c5-414b-afaa-75fdd4bbaf54 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:33.944320 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-37157e63-b6c5-414b-afaa-75fdd4bbaf54 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:33.960663 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-37157e63-b6c5-414b-afaa-75fdd4bbaf54 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:33.970767 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-37157e63-b6c5-414b-afaa-75fdd4bbaf54 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:33.973146 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-37157e63-b6c5-414b-afaa-75fdd4bbaf54 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:33.976706 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-37157e63-b6c5-414b-afaa-75fdd4bbaf54 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:34.097191 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Flavor limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:04:34.097641 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Image limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:04:34.097919 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Flavor pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:04:34.098325 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Image pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:04:34.098734 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:04:34.119677 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:34.120503 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:34.132885 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:34.133338 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:34.221325 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-37157e63-b6c5-414b-afaa-75fdd4bbaf54 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:34.233487 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Getting quotas for project efc6dbc546054e459498f200e327e75e. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:04:34.238399 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Getting quotas for user 10527eff7ddc473396e1ce848c39c7e9 and project efc6dbc546054e459498f200e327e75e. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:04:34.241243 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-37157e63-b6c5-414b-afaa-75fdd4bbaf54 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1226 microversion: 2.1 time: 0.310902 Jan 19 13:04:34.241838 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 15/34] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:33 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1226 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:34.269115 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Going to run 1 instances... {{(pid=116360) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:04:34.276626 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:04:34.436065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4dfbfcd9-89d9-4f6a-be87-c54c850187f7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.840097 Jan 19 13:04:34.437301 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 20/35] 10.222.0.48 () {62 vars in 1187 bytes} [Wed Jan 19 13:04:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1842 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 19 13:04:34.447123 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d45ed6d7-e62b-4322-8730-a4bf9e489441 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:34.448484 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d45ed6d7-e62b-4322-8730-a4bf9e489441 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:34.473234 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0ff03192-9f5d-4b1e-a7a8-41da654d135d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:34.474268 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0ff03192-9f5d-4b1e-a7a8-41da654d135d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:34.482696 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ff03192-9f5d-4b1e-a7a8-41da654d135d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:34.483444 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ff03192-9f5d-4b1e-a7a8-41da654d135d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:34.485552 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ff03192-9f5d-4b1e-a7a8-41da654d135d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:34.486265 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ff03192-9f5d-4b1e-a7a8-41da654d135d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:34.507355 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d45ed6d7-e62b-4322-8730-a4bf9e489441 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:34.515416 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d45ed6d7-e62b-4322-8730-a4bf9e489441 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:34.521823 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d45ed6d7-e62b-4322-8730-a4bf9e489441 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:34.527849 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d45ed6d7-e62b-4322-8730-a4bf9e489441 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1282 microversion: 2.20 time: 0.084461 Jan 19 13:04:34.531196 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 16/36] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:34 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:04:34.569349 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0ff03192-9f5d-4b1e-a7a8-41da654d135d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:34.577300 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0ff03192-9f5d-4b1e-a7a8-41da654d135d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1240 microversion: 2.1 time: 0.108165 Jan 19 13:04:34.578267 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 21/37] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:34 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1240 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:34.940311 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-beb6e3e2-3e6e-4b8b-8220-8df283aecf06 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:34.941126 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-beb6e3e2-3e6e-4b8b-8220-8df283aecf06 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:34.956670 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-beb6e3e2-3e6e-4b8b-8220-8df283aecf06 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:34.957120 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-beb6e3e2-3e6e-4b8b-8220-8df283aecf06 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:34.957909 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-beb6e3e2-3e6e-4b8b-8220-8df283aecf06 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:34.958845 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-beb6e3e2-3e6e-4b8b-8220-8df283aecf06 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:35.103025 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-beb6e3e2-3e6e-4b8b-8220-8df283aecf06 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:35.110389 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-beb6e3e2-3e6e-4b8b-8220-8df283aecf06 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.173740 Jan 19 13:04:35.110952 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 17/38] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:34 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:35.258420 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-631240c6-3614-44b0-9486-6ecbfa59266a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:35.259031 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-631240c6-3614-44b0-9486-6ecbfa59266a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:35.265224 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-631240c6-3614-44b0-9486-6ecbfa59266a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:35.265681 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-631240c6-3614-44b0-9486-6ecbfa59266a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:35.266604 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-631240c6-3614-44b0-9486-6ecbfa59266a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:35.267079 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-631240c6-3614-44b0-9486-6ecbfa59266a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:35.328606 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-631240c6-3614-44b0-9486-6ecbfa59266a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:35.337289 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-631240c6-3614-44b0-9486-6ecbfa59266a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1226 microversion: 2.1 time: 0.083081 Jan 19 13:04:35.338048 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 22/39] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:35 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:35.549676 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8ff0545b-d89a-4916-b4f3-f554a652b86a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:35.550375 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8ff0545b-d89a-4916-b4f3-f554a652b86a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:35.556640 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8ff0545b-d89a-4916-b4f3-f554a652b86a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:35.557175 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8ff0545b-d89a-4916-b4f3-f554a652b86a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:35.558040 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8ff0545b-d89a-4916-b4f3-f554a652b86a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:35.558572 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8ff0545b-d89a-4916-b4f3-f554a652b86a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:35.594352 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d466d7e7-b0cf-4e27-bf1c-895a25e2a0c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:35.594964 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d466d7e7-b0cf-4e27-bf1c-895a25e2a0c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:35.601604 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d466d7e7-b0cf-4e27-bf1c-895a25e2a0c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:35.602059 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d466d7e7-b0cf-4e27-bf1c-895a25e2a0c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:35.602865 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d466d7e7-b0cf-4e27-bf1c-895a25e2a0c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:35.603303 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d466d7e7-b0cf-4e27-bf1c-895a25e2a0c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:35.620029 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-8ff0545b-d89a-4916-b4f3-f554a652b86a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:35.632686 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-8ff0545b-d89a-4916-b4f3-f554a652b86a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:35.634396 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-8ff0545b-d89a-4916-b4f3-f554a652b86a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:35.635608 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8ff0545b-d89a-4916-b4f3-f554a652b86a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1286 microversion: 2.20 time: 0.090555 Jan 19 13:04:35.636608 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 18/40] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:35 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:04:35.668552 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d466d7e7-b0cf-4e27-bf1c-895a25e2a0c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:35.676392 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d466d7e7-b0cf-4e27-bf1c-895a25e2a0c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1240 microversion: 2.1 time: 0.085776 Jan 19 13:04:35.677910 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 23/41] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:35 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:36.127395 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4562689a-36fa-4898-b33e-78b2c07dd9b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:36.128082 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4562689a-36fa-4898-b33e-78b2c07dd9b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:36.135009 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4562689a-36fa-4898-b33e-78b2c07dd9b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:36.135465 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4562689a-36fa-4898-b33e-78b2c07dd9b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:36.136274 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4562689a-36fa-4898-b33e-78b2c07dd9b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:36.136721 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4562689a-36fa-4898-b33e-78b2c07dd9b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:36.293249 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4562689a-36fa-4898-b33e-78b2c07dd9b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:36.306425 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4562689a-36fa-4898-b33e-78b2c07dd9b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.182510 Jan 19 13:04:36.307012 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 19/42] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:36 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:36.358255 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3fb7dbbe-7792-45e1-93b5-225848d9c1ef tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:36.358964 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3fb7dbbe-7792-45e1-93b5-225848d9c1ef tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:36.367837 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3fb7dbbe-7792-45e1-93b5-225848d9c1ef tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:36.368560 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3fb7dbbe-7792-45e1-93b5-225848d9c1ef tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:36.370160 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3fb7dbbe-7792-45e1-93b5-225848d9c1ef tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:36.371333 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3fb7dbbe-7792-45e1-93b5-225848d9c1ef tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:36.448866 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3fb7dbbe-7792-45e1-93b5-225848d9c1ef tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:36.458020 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3fb7dbbe-7792-45e1-93b5-225848d9c1ef tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1226 microversion: 2.1 time: 0.105924 Jan 19 13:04:36.460126 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 24/43] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:36 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:36.654396 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e788a258-8976-4226-b2bd-317133230b98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:36.655142 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e788a258-8976-4226-b2bd-317133230b98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:36.661226 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e788a258-8976-4226-b2bd-317133230b98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:36.662320 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e788a258-8976-4226-b2bd-317133230b98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:36.663297 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e788a258-8976-4226-b2bd-317133230b98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:36.663744 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e788a258-8976-4226-b2bd-317133230b98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:36.694181 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-32224709-d8d5-45ae-a9f4-5e5ea1f56a33 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:36.694889 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-32224709-d8d5-45ae-a9f4-5e5ea1f56a33 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:36.714280 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-32224709-d8d5-45ae-a9f4-5e5ea1f56a33 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:36.714819 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-32224709-d8d5-45ae-a9f4-5e5ea1f56a33 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:36.715631 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-32224709-d8d5-45ae-a9f4-5e5ea1f56a33 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:36.719319 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-32224709-d8d5-45ae-a9f4-5e5ea1f56a33 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:36.732863 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e788a258-8976-4226-b2bd-317133230b98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:36.742533 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e788a258-8976-4226-b2bd-317133230b98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:36.744580 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e788a258-8976-4226-b2bd-317133230b98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:36.746861 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e788a258-8976-4226-b2bd-317133230b98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1286 microversion: 2.20 time: 0.095538 Jan 19 13:04:36.747627 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 20/44] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:36 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:04:36.814307 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-32224709-d8d5-45ae-a9f4-5e5ea1f56a33 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:36.827665 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-32224709-d8d5-45ae-a9f4-5e5ea1f56a33 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1240 microversion: 2.1 time: 0.137748 Jan 19 13:04:36.837659 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 25/45] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:36 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1240 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:37.323879 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9258e950-a24b-41cc-b914-fe1b7ebfc3d1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:37.324533 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9258e950-a24b-41cc-b914-fe1b7ebfc3d1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:37.330368 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9258e950-a24b-41cc-b914-fe1b7ebfc3d1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:37.330831 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9258e950-a24b-41cc-b914-fe1b7ebfc3d1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:37.331616 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9258e950-a24b-41cc-b914-fe1b7ebfc3d1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:37.332086 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9258e950-a24b-41cc-b914-fe1b7ebfc3d1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:37.474938 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-9258e950-a24b-41cc-b914-fe1b7ebfc3d1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:37.479589 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-78c9c632-7b69-492a-b184-14c7de3dc415 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:37.480201 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-78c9c632-7b69-492a-b184-14c7de3dc415 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:37.490788 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9258e950-a24b-41cc-b914-fe1b7ebfc3d1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.170244 Jan 19 13:04:37.491072 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-78c9c632-7b69-492a-b184-14c7de3dc415 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:37.491495 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-78c9c632-7b69-492a-b184-14c7de3dc415 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:37.494215 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-78c9c632-7b69-492a-b184-14c7de3dc415 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:37.494969 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-78c9c632-7b69-492a-b184-14c7de3dc415 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:37.495076 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 21/46] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:37 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:37.674687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-78c9c632-7b69-492a-b184-14c7de3dc415 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:37.682801 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-78c9c632-7b69-492a-b184-14c7de3dc415 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1226 microversion: 2.1 time: 0.206930 Jan 19 13:04:37.683370 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 26/47] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:37 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1226 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:37.765555 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ed6651b7-8201-4dfd-8d5a-20e150d02acb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:37.766165 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ed6651b7-8201-4dfd-8d5a-20e150d02acb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:37.772357 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed6651b7-8201-4dfd-8d5a-20e150d02acb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:37.772817 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed6651b7-8201-4dfd-8d5a-20e150d02acb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:37.773596 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed6651b7-8201-4dfd-8d5a-20e150d02acb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:37.774071 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed6651b7-8201-4dfd-8d5a-20e150d02acb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:37.830184 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ed6651b7-8201-4dfd-8d5a-20e150d02acb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:37.839405 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ed6651b7-8201-4dfd-8d5a-20e150d02acb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:37.839767 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ed6651b7-8201-4dfd-8d5a-20e150d02acb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:37.840972 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ed6651b7-8201-4dfd-8d5a-20e150d02acb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1286 microversion: 2.20 time: 0.079271 Jan 19 13:04:37.841723 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 22/48] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:37 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:04:37.847105 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ff290a18-05d3-44df-a5f6-de19bea621cb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:37.847722 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ff290a18-05d3-44df-a5f6-de19bea621cb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:37.855003 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff290a18-05d3-44df-a5f6-de19bea621cb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:37.855459 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff290a18-05d3-44df-a5f6-de19bea621cb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:37.856277 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff290a18-05d3-44df-a5f6-de19bea621cb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:37.856722 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff290a18-05d3-44df-a5f6-de19bea621cb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:37.917225 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ff290a18-05d3-44df-a5f6-de19bea621cb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:37.924749 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ff290a18-05d3-44df-a5f6-de19bea621cb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1240 microversion: 2.1 time: 0.082796 Jan 19 13:04:37.925259 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 27/49] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:37 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:38.510028 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-cb521e84-dae5-4c0d-9162-5e253df6a164 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:38.510562 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-cb521e84-dae5-4c0d-9162-5e253df6a164 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:38.516726 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cb521e84-dae5-4c0d-9162-5e253df6a164 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:38.517180 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cb521e84-dae5-4c0d-9162-5e253df6a164 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:38.517962 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cb521e84-dae5-4c0d-9162-5e253df6a164 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:38.518405 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cb521e84-dae5-4c0d-9162-5e253df6a164 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:38.658783 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-cb521e84-dae5-4c0d-9162-5e253df6a164 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:38.667519 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-cb521e84-dae5-4c0d-9162-5e253df6a164 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.161131 Jan 19 13:04:38.668778 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 23/50] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:38 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:38.699323 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c3152ca8-ca5c-4519-91f7-44a6e6857c2e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:38.699945 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c3152ca8-ca5c-4519-91f7-44a6e6857c2e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:38.706106 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c3152ca8-ca5c-4519-91f7-44a6e6857c2e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:38.706576 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c3152ca8-ca5c-4519-91f7-44a6e6857c2e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:38.707374 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c3152ca8-ca5c-4519-91f7-44a6e6857c2e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:38.707817 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c3152ca8-ca5c-4519-91f7-44a6e6857c2e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:38.777205 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c3152ca8-ca5c-4519-91f7-44a6e6857c2e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:38.784798 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c3152ca8-ca5c-4519-91f7-44a6e6857c2e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1226 microversion: 2.1 time: 0.089532 Jan 19 13:04:38.785358 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 28/51] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:38 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:38.870270 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5abfffdb-f3a9-4cdc-b753-8bc9443b65cf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:38.877073 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5abfffdb-f3a9-4cdc-b753-8bc9443b65cf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:38.885324 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5abfffdb-f3a9-4cdc-b753-8bc9443b65cf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:38.885741 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5abfffdb-f3a9-4cdc-b753-8bc9443b65cf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:38.886854 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5abfffdb-f3a9-4cdc-b753-8bc9443b65cf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:38.887349 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5abfffdb-f3a9-4cdc-b753-8bc9443b65cf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:38.943476 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b01891dc-20d3-41ae-9fef-b4059b2d165d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:38.944554 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b01891dc-20d3-41ae-9fef-b4059b2d165d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:38.951696 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5abfffdb-f3a9-4cdc-b753-8bc9443b65cf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:38.955872 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b01891dc-20d3-41ae-9fef-b4059b2d165d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:38.956518 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b01891dc-20d3-41ae-9fef-b4059b2d165d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:38.957592 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b01891dc-20d3-41ae-9fef-b4059b2d165d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:38.958659 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b01891dc-20d3-41ae-9fef-b4059b2d165d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:38.961781 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5abfffdb-f3a9-4cdc-b753-8bc9443b65cf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:38.963564 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5abfffdb-f3a9-4cdc-b753-8bc9443b65cf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:38.964765 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5abfffdb-f3a9-4cdc-b753-8bc9443b65cf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1286 microversion: 2.20 time: 0.109666 Jan 19 13:04:38.965516 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 24/52] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:38 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:04:39.046982 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b01891dc-20d3-41ae-9fef-b4059b2d165d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:39.056373 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b01891dc-20d3-41ae-9fef-b4059b2d165d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1240 microversion: 2.1 time: 0.117680 Jan 19 13:04:39.059855 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 29/53] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:38 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1240 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:39.684827 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ed8cb654-c1b1-491f-b962-07f7efaa55fb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:39.685831 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ed8cb654-c1b1-491f-b962-07f7efaa55fb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:39.693212 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed8cb654-c1b1-491f-b962-07f7efaa55fb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:39.693974 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed8cb654-c1b1-491f-b962-07f7efaa55fb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:39.694981 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed8cb654-c1b1-491f-b962-07f7efaa55fb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:39.695655 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed8cb654-c1b1-491f-b962-07f7efaa55fb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:39.803178 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-50269b3b-737a-4ddf-a523-43ce03388a7c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:39.803847 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-50269b3b-737a-4ddf-a523-43ce03388a7c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:39.811128 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50269b3b-737a-4ddf-a523-43ce03388a7c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:39.811596 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50269b3b-737a-4ddf-a523-43ce03388a7c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:39.812656 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50269b3b-737a-4ddf-a523-43ce03388a7c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:39.813104 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50269b3b-737a-4ddf-a523-43ce03388a7c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:39.863484 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ed8cb654-c1b1-491f-b962-07f7efaa55fb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:39.882071 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ed8cb654-c1b1-491f-b962-07f7efaa55fb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.200750 Jan 19 13:04:39.883381 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 25/54] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:39 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:39.886599 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-50269b3b-737a-4ddf-a523-43ce03388a7c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:39.896977 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-50269b3b-737a-4ddf-a523-43ce03388a7c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1226 microversion: 2.1 time: 0.098850 Jan 19 13:04:39.897585 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 30/55] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:39 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:39.984496 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-61cb1cf4-f57c-48e0-8c9a-12b0fb877c0e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:39.985225 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-61cb1cf4-f57c-48e0-8c9a-12b0fb877c0e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:39.993081 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-61cb1cf4-f57c-48e0-8c9a-12b0fb877c0e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:39.993639 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-61cb1cf4-f57c-48e0-8c9a-12b0fb877c0e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:39.994519 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-61cb1cf4-f57c-48e0-8c9a-12b0fb877c0e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:39.995011 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-61cb1cf4-f57c-48e0-8c9a-12b0fb877c0e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:40.064342 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-61cb1cf4-f57c-48e0-8c9a-12b0fb877c0e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:40.076886 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-be84d4e1-c14b-48f9-8023-086731f26670 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:40.077519 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-be84d4e1-c14b-48f9-8023-086731f26670 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:40.082076 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-61cb1cf4-f57c-48e0-8c9a-12b0fb877c0e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:40.084101 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-be84d4e1-c14b-48f9-8023-086731f26670 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:40.084460 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-61cb1cf4-f57c-48e0-8c9a-12b0fb877c0e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:40.084573 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-be84d4e1-c14b-48f9-8023-086731f26670 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:40.085466 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-be84d4e1-c14b-48f9-8023-086731f26670 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:40.085900 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-be84d4e1-c14b-48f9-8023-086731f26670 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:40.086270 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-61cb1cf4-f57c-48e0-8c9a-12b0fb877c0e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1286 microversion: 2.20 time: 0.105224 Jan 19 13:04:40.087052 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 26/56] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:39 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:04:40.144232 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-be84d4e1-c14b-48f9-8023-086731f26670 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:40.154112 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-be84d4e1-c14b-48f9-8023-086731f26670 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1240 microversion: 2.1 time: 0.081998 Jan 19 13:04:40.154873 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 31/57] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:40 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:40.902055 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ce7d4686-492e-4554-9bbd-135e8903958f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:40.904279 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ce7d4686-492e-4554-9bbd-135e8903958f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:40.914156 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c4e77b5d-5bba-466e-8a0f-146e25bdf67d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:40.914778 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c4e77b5d-5bba-466e-8a0f-146e25bdf67d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:40.925487 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c4e77b5d-5bba-466e-8a0f-146e25bdf67d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:40.925910 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ce7d4686-492e-4554-9bbd-135e8903958f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:40.926637 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ce7d4686-492e-4554-9bbd-135e8903958f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:40.927687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c4e77b5d-5bba-466e-8a0f-146e25bdf67d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:40.928513 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ce7d4686-492e-4554-9bbd-135e8903958f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:40.929029 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ce7d4686-492e-4554-9bbd-135e8903958f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:40.929687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c4e77b5d-5bba-466e-8a0f-146e25bdf67d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:40.930390 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c4e77b5d-5bba-466e-8a0f-146e25bdf67d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:41.082161 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c4e77b5d-5bba-466e-8a0f-146e25bdf67d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:41.091116 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c4e77b5d-5bba-466e-8a0f-146e25bdf67d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1226 microversion: 2.1 time: 0.181255 Jan 19 13:04:41.091730 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 32/58] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:40 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1226 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:41.106980 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3255a9bd-7057-45cf-9b36-452d00386baf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:41.108288 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3255a9bd-7057-45cf-9b36-452d00386baf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:41.117945 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3255a9bd-7057-45cf-9b36-452d00386baf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:41.119062 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3255a9bd-7057-45cf-9b36-452d00386baf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:41.120797 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3255a9bd-7057-45cf-9b36-452d00386baf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:41.122291 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3255a9bd-7057-45cf-9b36-452d00386baf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:41.220612 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3255a9bd-7057-45cf-9b36-452d00386baf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:41.229551 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3255a9bd-7057-45cf-9b36-452d00386baf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:41.231298 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3255a9bd-7057-45cf-9b36-452d00386baf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:41.232746 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3255a9bd-7057-45cf-9b36-452d00386baf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1286 microversion: 2.20 time: 0.131880 Jan 19 13:04:41.233808 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 33/59] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:41 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:04:41.238182 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ce7d4686-492e-4554-9bbd-135e8903958f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:41.248464 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-8f93081b-c2ee-48ea-9162-8d89027471de tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:41.249078 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-8f93081b-c2ee-48ea-9162-8d89027471de tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:41.252586 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ce7d4686-492e-4554-9bbd-135e8903958f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.356564 Jan 19 13:04:41.253580 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 27/60] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:40 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:41.262760 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8f93081b-c2ee-48ea-9162-8d89027471de tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:41.263469 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8f93081b-c2ee-48ea-9162-8d89027471de tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:41.264309 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8f93081b-c2ee-48ea-9162-8d89027471de tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:41.264920 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8f93081b-c2ee-48ea-9162-8d89027471de tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:41.366397 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-8f93081b-c2ee-48ea-9162-8d89027471de tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:41.374565 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-8f93081b-c2ee-48ea-9162-8d89027471de tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1240 microversion: 2.1 time: 0.139497 Jan 19 13:04:41.375141 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 34/61] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:41 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1240 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:42.112293 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0c90dbd8-c52b-4b9f-a59e-1fddc311aecd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:42.112912 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0c90dbd8-c52b-4b9f-a59e-1fddc311aecd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:42.119083 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0c90dbd8-c52b-4b9f-a59e-1fddc311aecd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:42.119814 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0c90dbd8-c52b-4b9f-a59e-1fddc311aecd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:42.120880 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0c90dbd8-c52b-4b9f-a59e-1fddc311aecd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:42.121317 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0c90dbd8-c52b-4b9f-a59e-1fddc311aecd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:42.200687 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0c90dbd8-c52b-4b9f-a59e-1fddc311aecd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:42.211109 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0c90dbd8-c52b-4b9f-a59e-1fddc311aecd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1226 microversion: 2.1 time: 0.105501 Jan 19 13:04:42.225013 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 28/62] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:42 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:42.250649 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0ec0976a-4829-4f41-9b92-b3a9b2425fe9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:42.251259 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0ec0976a-4829-4f41-9b92-b3a9b2425fe9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:42.257945 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ec0976a-4829-4f41-9b92-b3a9b2425fe9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:42.258394 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ec0976a-4829-4f41-9b92-b3a9b2425fe9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:42.259172 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ec0976a-4829-4f41-9b92-b3a9b2425fe9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:42.259860 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ec0976a-4829-4f41-9b92-b3a9b2425fe9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:42.270410 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d131e3c9-22f6-434c-a740-331737271fcd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:42.271819 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d131e3c9-22f6-434c-a740-331737271fcd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:42.277968 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d131e3c9-22f6-434c-a740-331737271fcd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:42.278633 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d131e3c9-22f6-434c-a740-331737271fcd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:42.279409 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d131e3c9-22f6-434c-a740-331737271fcd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:42.279840 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d131e3c9-22f6-434c-a740-331737271fcd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:42.342844 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0ec0976a-4829-4f41-9b92-b3a9b2425fe9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:42.351703 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0ec0976a-4829-4f41-9b92-b3a9b2425fe9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:42.353253 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0ec0976a-4829-4f41-9b92-b3a9b2425fe9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:42.354356 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0ec0976a-4829-4f41-9b92-b3a9b2425fe9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1286 microversion: 2.20 time: 0.107404 Jan 19 13:04:42.355092 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 35/63] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:42 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:04:42.392941 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9ddbac19-0dc1-49b6-9862-ea7ff6ac2fdc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:42.393905 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9ddbac19-0dc1-49b6-9862-ea7ff6ac2fdc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:42.401364 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9ddbac19-0dc1-49b6-9862-ea7ff6ac2fdc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:42.402083 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9ddbac19-0dc1-49b6-9862-ea7ff6ac2fdc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:42.403070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9ddbac19-0dc1-49b6-9862-ea7ff6ac2fdc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:42.403697 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9ddbac19-0dc1-49b6-9862-ea7ff6ac2fdc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:42.477787 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-9ddbac19-0dc1-49b6-9862-ea7ff6ac2fdc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:42.488286 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9ddbac19-0dc1-49b6-9862-ea7ff6ac2fdc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1240 microversion: 2.1 time: 0.097805 Jan 19 13:04:42.499485 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 36/64] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:42 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:42.519899 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d131e3c9-22f6-434c-a740-331737271fcd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:42.528742 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d131e3c9-22f6-434c-a740-331737271fcd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.261942 Jan 19 13:04:42.529404 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 29/65] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:42 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:43.233808 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9128394c-4d86-4c33-864c-1a035a74e1c6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:43.234542 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9128394c-4d86-4c33-864c-1a035a74e1c6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:43.244990 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9128394c-4d86-4c33-864c-1a035a74e1c6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:43.245445 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9128394c-4d86-4c33-864c-1a035a74e1c6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:43.246249 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9128394c-4d86-4c33-864c-1a035a74e1c6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:43.246689 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9128394c-4d86-4c33-864c-1a035a74e1c6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:43.366974 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-9128394c-4d86-4c33-864c-1a035a74e1c6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:43.373661 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0833c93a-cbe9-438d-bd74-cde5933ab5f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:43.375092 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0833c93a-cbe9-438d-bd74-cde5933ab5f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:43.390664 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9128394c-4d86-4c33-864c-1a035a74e1c6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1274 microversion: 2.1 time: 0.163384 Jan 19 13:04:43.391256 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 37/66] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:43 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:43.402864 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0833c93a-cbe9-438d-bd74-cde5933ab5f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:43.405409 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0833c93a-cbe9-438d-bd74-cde5933ab5f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:43.406441 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0833c93a-cbe9-438d-bd74-cde5933ab5f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:43.409027 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0833c93a-cbe9-438d-bd74-cde5933ab5f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:43.495339 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0833c93a-cbe9-438d-bd74-cde5933ab5f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:43.508489 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7c88df00-1f18-47f4-b07a-b9ca12c8bd22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:43.508489 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7c88df00-1f18-47f4-b07a-b9ca12c8bd22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:43.511383 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0833c93a-cbe9-438d-bd74-cde5933ab5f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:43.513648 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0833c93a-cbe9-438d-bd74-cde5933ab5f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:43.515769 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0833c93a-cbe9-438d-bd74-cde5933ab5f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1278 microversion: 2.20 time: 0.146266 Jan 19 13:04:43.516924 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 30/67] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:43 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1278 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:04:43.530631 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7c88df00-1f18-47f4-b07a-b9ca12c8bd22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:43.531460 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7c88df00-1f18-47f4-b07a-b9ca12c8bd22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:43.534632 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7c88df00-1f18-47f4-b07a-b9ca12c8bd22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:43.537885 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7c88df00-1f18-47f4-b07a-b9ca12c8bd22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:43.555521 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-47b5257b-9368-46ad-8efc-068201a8fcfd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:43.562390 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-47b5257b-9368-46ad-8efc-068201a8fcfd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:43.589651 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-47b5257b-9368-46ad-8efc-068201a8fcfd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:43.590942 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-47b5257b-9368-46ad-8efc-068201a8fcfd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:43.597524 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-47b5257b-9368-46ad-8efc-068201a8fcfd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:43.599275 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-47b5257b-9368-46ad-8efc-068201a8fcfd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:43.762533 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7c88df00-1f18-47f4-b07a-b9ca12c8bd22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:43.777317 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7c88df00-1f18-47f4-b07a-b9ca12c8bd22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1288 microversion: 2.1 time: 0.272758 Jan 19 13:04:43.788301 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 38/68] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:43 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1288 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:43.974760 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-47b5257b-9368-46ad-8efc-068201a8fcfd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:44.004943 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-47b5257b-9368-46ad-8efc-068201a8fcfd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.458114 Jan 19 13:04:44.006602 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 31/69] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:43 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:44.413730 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-bc913a75-bca1-48f2-9f04-71c7cd7df854 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:44.416320 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-bc913a75-bca1-48f2-9f04-71c7cd7df854 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:44.428616 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bc913a75-bca1-48f2-9f04-71c7cd7df854 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:44.431708 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bc913a75-bca1-48f2-9f04-71c7cd7df854 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:44.435930 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bc913a75-bca1-48f2-9f04-71c7cd7df854 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:44.436699 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bc913a75-bca1-48f2-9f04-71c7cd7df854 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:44.546891 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e28b153d-bd86-4174-b39b-84462556e900 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:44.553721 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e28b153d-bd86-4174-b39b-84462556e900 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:44.572165 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e28b153d-bd86-4174-b39b-84462556e900 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:44.575379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e28b153d-bd86-4174-b39b-84462556e900 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:44.576440 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e28b153d-bd86-4174-b39b-84462556e900 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:44.589484 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e28b153d-bd86-4174-b39b-84462556e900 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:44.688149 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bc913a75-bca1-48f2-9f04-71c7cd7df854 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:44.703865 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-bc913a75-bca1-48f2-9f04-71c7cd7df854 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1292 microversion: 2.1 time: 0.299103 Jan 19 13:04:44.723258 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 39/70] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:44 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1292 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:44.805058 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d41c3533-a110-4fe4-8959-259d71ce787e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:44.805670 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d41c3533-a110-4fe4-8959-259d71ce787e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:44.815435 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d41c3533-a110-4fe4-8959-259d71ce787e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:44.815893 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d41c3533-a110-4fe4-8959-259d71ce787e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:44.816709 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d41c3533-a110-4fe4-8959-259d71ce787e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:44.820516 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d41c3533-a110-4fe4-8959-259d71ce787e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:44.824736 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e28b153d-bd86-4174-b39b-84462556e900 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:44.842829 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e28b153d-bd86-4174-b39b-84462556e900 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:44.845783 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e28b153d-bd86-4174-b39b-84462556e900 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:44.847805 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e28b153d-bd86-4174-b39b-84462556e900 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1340 microversion: 2.20 time: 0.313359 Jan 19 13:04:44.861119 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 32/71] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:44 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1340 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:04:45.026669 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-502ba2fc-b46e-40ad-8441-0e90d0aa4a38 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:45.027559 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-502ba2fc-b46e-40ad-8441-0e90d0aa4a38 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:45.041013 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-502ba2fc-b46e-40ad-8441-0e90d0aa4a38 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:45.044757 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-502ba2fc-b46e-40ad-8441-0e90d0aa4a38 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:45.050180 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-502ba2fc-b46e-40ad-8441-0e90d0aa4a38 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:45.050840 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-502ba2fc-b46e-40ad-8441-0e90d0aa4a38 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:45.188274 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d41c3533-a110-4fe4-8959-259d71ce787e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:45.204371 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d41c3533-a110-4fe4-8959-259d71ce787e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1294 microversion: 2.1 time: 0.403628 Jan 19 13:04:45.219756 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 40/72] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:44 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1294 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:45.729679 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-cf611f64-8e84-48a3-9ad8-e4774fbf9080 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:45.731134 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-cf611f64-8e84-48a3-9ad8-e4774fbf9080 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:45.741715 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf611f64-8e84-48a3-9ad8-e4774fbf9080 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:45.743953 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf611f64-8e84-48a3-9ad8-e4774fbf9080 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:45.745019 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf611f64-8e84-48a3-9ad8-e4774fbf9080 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:45.746841 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf611f64-8e84-48a3-9ad8-e4774fbf9080 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:45.895260 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-502ba2fc-b46e-40ad-8441-0e90d0aa4a38 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:45.912108 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-502ba2fc-b46e-40ad-8441-0e90d0aa4a38 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.892345 Jan 19 13:04:45.922059 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 33/73] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:45 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:45.939511 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-cf611f64-8e84-48a3-9ad8-e4774fbf9080 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:45.949767 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-16d711c3-3239-46af-a2e0-6eeb6e5370bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:45.957480 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-16d711c3-3239-46af-a2e0-6eeb6e5370bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:45.962846 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-cf611f64-8e84-48a3-9ad8-e4774fbf9080 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1280 microversion: 2.1 time: 0.236662 Jan 19 13:04:45.967070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 41/74] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:45 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1280 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:45.982639 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-16d711c3-3239-46af-a2e0-6eeb6e5370bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:45.983579 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-16d711c3-3239-46af-a2e0-6eeb6e5370bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:45.984768 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-16d711c3-3239-46af-a2e0-6eeb6e5370bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:45.985209 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-16d711c3-3239-46af-a2e0-6eeb6e5370bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:46.196875 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-16d711c3-3239-46af-a2e0-6eeb6e5370bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:46.225974 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-16d711c3-3239-46af-a2e0-6eeb6e5370bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:46.231628 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-16d711c3-3239-46af-a2e0-6eeb6e5370bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:46.234446 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-16d711c3-3239-46af-a2e0-6eeb6e5370bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1340 microversion: 2.20 time: 0.309041 Jan 19 13:04:46.235882 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 34/75] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:45 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1340 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:04:46.243638 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b66018af-eaf3-42bb-8c85-ecc964f25fc2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:46.244595 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b66018af-eaf3-42bb-8c85-ecc964f25fc2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:46.252864 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b66018af-eaf3-42bb-8c85-ecc964f25fc2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:46.253618 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b66018af-eaf3-42bb-8c85-ecc964f25fc2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:46.254615 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b66018af-eaf3-42bb-8c85-ecc964f25fc2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:46.255317 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b66018af-eaf3-42bb-8c85-ecc964f25fc2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:46.380271 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b66018af-eaf3-42bb-8c85-ecc964f25fc2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:46.390690 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b66018af-eaf3-42bb-8c85-ecc964f25fc2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1294 microversion: 2.1 time: 0.153274 Jan 19 13:04:46.400489 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 35/76] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:46 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1294 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:46.480432 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-5043f3b4-af7e-4e96-8166-611fb3a81b83 req-f9d64ecc-054d-4d50-bfe3-d6ebe5a75324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa85ce7-f190-47c1-bf94-e1d5d7b98070", "tag": "c2682348-227e-4a90-8c47-f6e3e523ed6d"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:04:46.482611 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:04:46.482611 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:04:46.523595 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-5043f3b4-af7e-4e96-8166-611fb3a81b83 req-f9d64ecc-054d-4d50-bfe3-d6ebe5a75324 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:46.528372 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-5043f3b4-af7e-4e96-8166-611fb3a81b83 req-f9d64ecc-054d-4d50-bfe3-d6ebe5a75324 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:46.587615 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-5043f3b4-af7e-4e96-8166-611fb3a81b83 req-f9d64ecc-054d-4d50-bfe3-d6ebe5a75324 service nova] Creating event network-changed:c2682348-227e-4a90-8c47-f6e3e523ed6d for instance 3fa85ce7-f190-47c1-bf94-e1d5d7b98070 on hv-cinder-82301 Jan 19 13:04:46.590054 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-5043f3b4-af7e-4e96-8166-611fb3a81b83 req-f9d64ecc-054d-4d50-bfe3-d6ebe5a75324 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 19 13:04:46.593229 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c6498a61-1e15-4de1-9aec-b87224174984 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:46.593925 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c6498a61-1e15-4de1-9aec-b87224174984 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:46.595058 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c6498a61-1e15-4de1-9aec-b87224174984 None None] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:46.597003 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c6498a61-1e15-4de1-9aec-b87224174984 None None] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:46.621032 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.compute.rpcapi [None req-c6498a61-1e15-4de1-9aec-b87224174984 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 19 13:04:46.622184 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c6498a61-1e15-4de1-9aec-b87224174984 None None] Releasing lock "compute-rpcapi-router" {{(pid=116360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 19 13:04:46.640765 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c6498a61-1e15-4de1-9aec-b87224174984 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.516358 Jan 19 13:04:46.641761 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 42/77] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:04:46.944485 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3c1120bb-2c07-4600-88ff-e739a215f541 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:46.949665 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3c1120bb-2c07-4600-88ff-e739a215f541 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:46.977467 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3c1120bb-2c07-4600-88ff-e739a215f541 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:46.977982 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3c1120bb-2c07-4600-88ff-e739a215f541 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:46.978831 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3c1120bb-2c07-4600-88ff-e739a215f541 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:46.980904 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3c1120bb-2c07-4600-88ff-e739a215f541 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:46.991277 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d24bb694-bf34-4ba1-b157-f8c554bc793e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:46.992142 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d24bb694-bf34-4ba1-b157-f8c554bc793e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:47.003904 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d24bb694-bf34-4ba1-b157-f8c554bc793e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:47.005062 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d24bb694-bf34-4ba1-b157-f8c554bc793e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:47.006287 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d24bb694-bf34-4ba1-b157-f8c554bc793e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:47.006999 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d24bb694-bf34-4ba1-b157-f8c554bc793e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:47.312843 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d24bb694-bf34-4ba1-b157-f8c554bc793e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:47.323598 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d24bb694-bf34-4ba1-b157-f8c554bc793e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1280 microversion: 2.1 time: 0.334990 Jan 19 13:04:47.324266 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 43/78] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:46 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1280 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:47.333998 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e4be91d9-b3fd-48ac-9897-dd61a16a9e1e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:47.334863 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e4be91d9-b3fd-48ac-9897-dd61a16a9e1e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:47.344275 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e4be91d9-b3fd-48ac-9897-dd61a16a9e1e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:47.347273 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e4be91d9-b3fd-48ac-9897-dd61a16a9e1e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:47.349760 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e4be91d9-b3fd-48ac-9897-dd61a16a9e1e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:47.350612 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e4be91d9-b3fd-48ac-9897-dd61a16a9e1e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:47.470359 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-e4be91d9-b3fd-48ac-9897-dd61a16a9e1e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:47.487609 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-e4be91d9-b3fd-48ac-9897-dd61a16a9e1e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:47.491088 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-e4be91d9-b3fd-48ac-9897-dd61a16a9e1e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:47.494395 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e4be91d9-b3fd-48ac-9897-dd61a16a9e1e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1340 microversion: 2.20 time: 0.167797 Jan 19 13:04:47.496947 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 44/79] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:47 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1340 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:04:47.511452 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f9c95233-432f-4645-a95c-101be7d01c22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:47.512300 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f9c95233-432f-4645-a95c-101be7d01c22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:47.527686 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9c95233-432f-4645-a95c-101be7d01c22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:47.528285 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9c95233-432f-4645-a95c-101be7d01c22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:47.530024 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9c95233-432f-4645-a95c-101be7d01c22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:47.531379 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9c95233-432f-4645-a95c-101be7d01c22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:47.877324 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3c1120bb-2c07-4600-88ff-e739a215f541 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:47.890003 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3c1120bb-2c07-4600-88ff-e739a215f541 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.955727 Jan 19 13:04:47.892808 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 36/80] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:46 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:48.340787 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f817554d-82bc-48f8-91ca-de971b7d0efc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:48.342236 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f817554d-82bc-48f8-91ca-de971b7d0efc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:48.349923 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f817554d-82bc-48f8-91ca-de971b7d0efc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:48.350717 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f817554d-82bc-48f8-91ca-de971b7d0efc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:48.362381 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f817554d-82bc-48f8-91ca-de971b7d0efc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:48.363020 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f817554d-82bc-48f8-91ca-de971b7d0efc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:48.561028 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f817554d-82bc-48f8-91ca-de971b7d0efc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:48.572372 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f817554d-82bc-48f8-91ca-de971b7d0efc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1280 microversion: 2.1 time: 0.233185 Jan 19 13:04:48.574884 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 37/81] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:48 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1280 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:48.581067 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6ddd901b-9223-4f89-9b04-852bd2acc5e9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:48.581856 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6ddd901b-9223-4f89-9b04-852bd2acc5e9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:48.590878 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6ddd901b-9223-4f89-9b04-852bd2acc5e9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:48.592643 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6ddd901b-9223-4f89-9b04-852bd2acc5e9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:48.594157 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6ddd901b-9223-4f89-9b04-852bd2acc5e9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:48.595080 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6ddd901b-9223-4f89-9b04-852bd2acc5e9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:48.746842 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f9c95233-432f-4645-a95c-101be7d01c22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:48.758717 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f9c95233-432f-4645-a95c-101be7d01c22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 1.260557 Jan 19 13:04:48.759555 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 45/82] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:47 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:48.909025 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c4edee44-5413-4a7b-adf0-97f109e52553 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:48.909552 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c4edee44-5413-4a7b-adf0-97f109e52553 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:48.915724 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c4edee44-5413-4a7b-adf0-97f109e52553 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:48.916511 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c4edee44-5413-4a7b-adf0-97f109e52553 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:48.917307 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c4edee44-5413-4a7b-adf0-97f109e52553 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:48.917749 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c4edee44-5413-4a7b-adf0-97f109e52553 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:49.159647 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6ddd901b-9223-4f89-9b04-852bd2acc5e9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:49.172328 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6ddd901b-9223-4f89-9b04-852bd2acc5e9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:49.174320 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6ddd901b-9223-4f89-9b04-852bd2acc5e9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:49.176397 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6ddd901b-9223-4f89-9b04-852bd2acc5e9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.600049 Jan 19 13:04:49.178172 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 38/83] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:48 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:04:49.327321 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-2cc08907-8db2-44d3-943e-79678f7a7437 req-36b7e496-611a-43d4-b12c-810ebd37d0cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b74c954-19e1-498d-a9b6-c0fb2663635a", "tag": "f0c36288-465f-49ee-ad3b-75329de2fc61"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:04:49.332120 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:04:49.332120 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:04:49.365392 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-2cc08907-8db2-44d3-943e-79678f7a7437 req-36b7e496-611a-43d4-b12c-810ebd37d0cc service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:49.366017 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-2cc08907-8db2-44d3-943e-79678f7a7437 req-36b7e496-611a-43d4-b12c-810ebd37d0cc service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:49.386394 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-2cc08907-8db2-44d3-943e-79678f7a7437 req-36b7e496-611a-43d4-b12c-810ebd37d0cc service nova] Creating event network-changed:f0c36288-465f-49ee-ad3b-75329de2fc61 for instance 9b74c954-19e1-498d-a9b6-c0fb2663635a on hv-cinder-82301 Jan 19 13:04:49.387077 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-2cc08907-8db2-44d3-943e-79678f7a7437 req-36b7e496-611a-43d4-b12c-810ebd37d0cc service nova] Acquired lock "compute-rpcapi-router" {{(pid=116361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 19 13:04:49.389410 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9ddcd04a-726a-4320-b81f-42ccf829d83b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:49.390091 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9ddcd04a-726a-4320-b81f-42ccf829d83b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:49.390939 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9ddcd04a-726a-4320-b81f-42ccf829d83b None None] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:49.391513 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9ddcd04a-726a-4320-b81f-42ccf829d83b None None] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:49.396423 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c4edee44-5413-4a7b-adf0-97f109e52553 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:49.402149 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.compute.rpcapi [None req-9ddcd04a-726a-4320-b81f-42ccf829d83b None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 19 13:04:49.403405 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9ddcd04a-726a-4320-b81f-42ccf829d83b None None] Releasing lock "compute-rpcapi-router" {{(pid=116361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 19 13:04:49.405325 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c4edee44-5413-4a7b-adf0-97f109e52553 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.500136 Jan 19 13:04:49.415648 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 46/84] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:48 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:49.444136 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9ddcd04a-726a-4320-b81f-42ccf829d83b None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125247 Jan 19 13:04:49.444955 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 39/85] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:04:49.593189 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ed81a7bd-ac88-4e4b-8ee5-12db4f9ac31c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:49.596362 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ed81a7bd-ac88-4e4b-8ee5-12db4f9ac31c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:49.604757 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ed81a7bd-ac88-4e4b-8ee5-12db4f9ac31c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:49.605966 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ed81a7bd-ac88-4e4b-8ee5-12db4f9ac31c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:49.606951 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ed81a7bd-ac88-4e4b-8ee5-12db4f9ac31c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:49.614041 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ed81a7bd-ac88-4e4b-8ee5-12db4f9ac31c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:49.797744 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b15df5e9-7c52-446e-8274-0c699ced15f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:49.800063 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b15df5e9-7c52-446e-8274-0c699ced15f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:49.830818 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b15df5e9-7c52-446e-8274-0c699ced15f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:49.831893 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b15df5e9-7c52-446e-8274-0c699ced15f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:49.833139 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b15df5e9-7c52-446e-8274-0c699ced15f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:49.833824 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b15df5e9-7c52-446e-8274-0c699ced15f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:50.171867 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ed81a7bd-ac88-4e4b-8ee5-12db4f9ac31c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:50.178964 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ed81a7bd-ac88-4e4b-8ee5-12db4f9ac31c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.591913 Jan 19 13:04:50.188076 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 47/86] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:49 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:50.197474 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-31f4d6b0-60ee-4aba-9d99-9b50e140784c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:50.197977 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-31f4d6b0-60ee-4aba-9d99-9b50e140784c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:50.204333 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-31f4d6b0-60ee-4aba-9d99-9b50e140784c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:50.204860 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-31f4d6b0-60ee-4aba-9d99-9b50e140784c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:50.205820 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-31f4d6b0-60ee-4aba-9d99-9b50e140784c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:50.206258 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-31f4d6b0-60ee-4aba-9d99-9b50e140784c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:50.563142 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b15df5e9-7c52-446e-8274-0c699ced15f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:50.572474 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b15df5e9-7c52-446e-8274-0c699ced15f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.797295 Jan 19 13:04:50.579310 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 40/87] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:49 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:50.589100 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b51dcda1-141d-4c12-bc88-7c77201ad96b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:50.589884 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b51dcda1-141d-4c12-bc88-7c77201ad96b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:50.602769 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b51dcda1-141d-4c12-bc88-7c77201ad96b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:50.603398 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b51dcda1-141d-4c12-bc88-7c77201ad96b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:50.604388 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b51dcda1-141d-4c12-bc88-7c77201ad96b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:50.612719 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b51dcda1-141d-4c12-bc88-7c77201ad96b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:50.981696 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-31f4d6b0-60ee-4aba-9d99-9b50e140784c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:50.995720 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-31f4d6b0-60ee-4aba-9d99-9b50e140784c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:51.004330 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-31f4d6b0-60ee-4aba-9d99-9b50e140784c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:51.006790 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-31f4d6b0-60ee-4aba-9d99-9b50e140784c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.814991 Jan 19 13:04:51.014232 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 48/88] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:50 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:04:51.074382 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b51dcda1-141d-4c12-bc88-7c77201ad96b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:51.085973 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b51dcda1-141d-4c12-bc88-7c77201ad96b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.505344 Jan 19 13:04:51.097085 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 41/89] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:50 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:51.172567 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-a956d65a-776a-4d93-ab79-4172ca13a5a9 req-a74709d7-c6c0-49da-9364-f7c089929050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2fc94f-e55f-4947-9824-ffc6edf35e0c", "tag": "7e0a83a8-36d8-4d5c-baf5-d9396dafdb38"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:04:51.175157 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:04:51.175157 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:04:51.183357 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-a956d65a-776a-4d93-ab79-4172ca13a5a9 req-a74709d7-c6c0-49da-9364-f7c089929050 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:51.183796 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-a956d65a-776a-4d93-ab79-4172ca13a5a9 req-a74709d7-c6c0-49da-9364-f7c089929050 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:51.195911 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-a956d65a-776a-4d93-ab79-4172ca13a5a9 req-a74709d7-c6c0-49da-9364-f7c089929050 service nova] Creating event network-changed:7e0a83a8-36d8-4d5c-baf5-d9396dafdb38 for instance 0a2fc94f-e55f-4947-9824-ffc6edf35e0c on hv-cinder-82301 Jan 19 13:04:51.196079 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-99e7b2ca-96ed-489f-9463-c8e2e2577843 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:51.196646 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-99e7b2ca-96ed-489f-9463-c8e2e2577843 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:51.201585 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-a956d65a-776a-4d93-ab79-4172ca13a5a9 req-a74709d7-c6c0-49da-9364-f7c089929050 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184121 Jan 19 13:04:51.202690 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 49/90] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:04:51.203490 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-99e7b2ca-96ed-489f-9463-c8e2e2577843 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:51.203875 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-99e7b2ca-96ed-489f-9463-c8e2e2577843 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:51.204691 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-99e7b2ca-96ed-489f-9463-c8e2e2577843 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:51.205124 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-99e7b2ca-96ed-489f-9463-c8e2e2577843 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:51.350717 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-99e7b2ca-96ed-489f-9463-c8e2e2577843 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:51.358011 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-99e7b2ca-96ed-489f-9463-c8e2e2577843 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.166938 Jan 19 13:04:51.358580 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 42/91] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:51 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:51.594655 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-dd03f7d1-f767-44ea-9460-9eeade06c5ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:51.595347 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-dd03f7d1-f767-44ea-9460-9eeade06c5ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:51.602280 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dd03f7d1-f767-44ea-9460-9eeade06c5ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:51.602925 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dd03f7d1-f767-44ea-9460-9eeade06c5ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:51.603762 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dd03f7d1-f767-44ea-9460-9eeade06c5ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:51.604245 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dd03f7d1-f767-44ea-9460-9eeade06c5ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:51.746805 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-dd03f7d1-f767-44ea-9460-9eeade06c5ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:51.754571 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-dd03f7d1-f767-44ea-9460-9eeade06c5ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.163743 Jan 19 13:04:51.763253 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 50/92] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:51 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:52.028201 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5298e7a5-8254-4355-9a71-a373293f3878 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:52.029306 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5298e7a5-8254-4355-9a71-a373293f3878 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:52.035379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5298e7a5-8254-4355-9a71-a373293f3878 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:52.035829 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5298e7a5-8254-4355-9a71-a373293f3878 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:52.037731 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5298e7a5-8254-4355-9a71-a373293f3878 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:52.038172 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5298e7a5-8254-4355-9a71-a373293f3878 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:52.103858 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3517b47d-0fd8-4b5e-a7fe-2237989dc8a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:52.104519 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3517b47d-0fd8-4b5e-a7fe-2237989dc8a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:52.110755 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3517b47d-0fd8-4b5e-a7fe-2237989dc8a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:52.111415 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3517b47d-0fd8-4b5e-a7fe-2237989dc8a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:52.113392 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3517b47d-0fd8-4b5e-a7fe-2237989dc8a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:52.113998 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3517b47d-0fd8-4b5e-a7fe-2237989dc8a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:52.221413 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5298e7a5-8254-4355-9a71-a373293f3878 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:52.231527 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5298e7a5-8254-4355-9a71-a373293f3878 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:52.233179 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5298e7a5-8254-4355-9a71-a373293f3878 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:52.234186 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5298e7a5-8254-4355-9a71-a373293f3878 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.209669 Jan 19 13:04:52.234752 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 43/93] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:52 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:04:52.293602 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3517b47d-0fd8-4b5e-a7fe-2237989dc8a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:52.302528 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3517b47d-0fd8-4b5e-a7fe-2237989dc8a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.201811 Jan 19 13:04:52.303741 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 51/94] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:52 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:52.374443 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6714f244-ad7b-4d13-94bd-8c5a7e83a40a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:52.375058 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6714f244-ad7b-4d13-94bd-8c5a7e83a40a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:52.381602 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6714f244-ad7b-4d13-94bd-8c5a7e83a40a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:52.382055 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6714f244-ad7b-4d13-94bd-8c5a7e83a40a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:52.382839 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6714f244-ad7b-4d13-94bd-8c5a7e83a40a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:52.383277 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6714f244-ad7b-4d13-94bd-8c5a7e83a40a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:52.511747 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6714f244-ad7b-4d13-94bd-8c5a7e83a40a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:52.519218 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6714f244-ad7b-4d13-94bd-8c5a7e83a40a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.148348 Jan 19 13:04:52.519783 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 44/95] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:52 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:52.771508 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-28506f4a-8d1a-4f51-ab4e-91beb96ca46f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:52.772209 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-28506f4a-8d1a-4f51-ab4e-91beb96ca46f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:52.778023 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-28506f4a-8d1a-4f51-ab4e-91beb96ca46f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:52.778482 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-28506f4a-8d1a-4f51-ab4e-91beb96ca46f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:52.779259 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-28506f4a-8d1a-4f51-ab4e-91beb96ca46f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:52.779771 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-28506f4a-8d1a-4f51-ab4e-91beb96ca46f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:52.922918 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-28506f4a-8d1a-4f51-ab4e-91beb96ca46f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:52.931058 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-28506f4a-8d1a-4f51-ab4e-91beb96ca46f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.163848 Jan 19 13:04:52.931619 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 52/96] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:52 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:53.216670 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-27c4b6c6-496e-4b4b-96b2-86049607191d req-f2ce5a32-46a4-464f-917b-4ced88f5a29e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c0570c-1d8d-41ff-9ec2-9325d1a121ca", "tag": "ffc3ee9b-e03d-44c4-a33d-39af979abf14"}, {"name": "network-changed", "server_uuid": "5a7999cb-80e5-4ad9-aed4-efea6e23ffa7", "tag": "958818e4-6792-4499-aa84-8ad5cc852465"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:04:53.219127 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:04:53.219127 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:04:53.227843 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-27c4b6c6-496e-4b4b-96b2-86049607191d req-f2ce5a32-46a4-464f-917b-4ced88f5a29e service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:53.228313 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-27c4b6c6-496e-4b4b-96b2-86049607191d req-f2ce5a32-46a4-464f-917b-4ced88f5a29e service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:53.242400 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-27c4b6c6-496e-4b4b-96b2-86049607191d req-f2ce5a32-46a4-464f-917b-4ced88f5a29e service nova] Creating event network-changed:ffc3ee9b-e03d-44c4-a33d-39af979abf14 for instance e4c0570c-1d8d-41ff-9ec2-9325d1a121ca on hv-cinder-82301 Jan 19 13:04:53.242904 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-27c4b6c6-496e-4b4b-96b2-86049607191d req-f2ce5a32-46a4-464f-917b-4ced88f5a29e service nova] Creating event network-changed:958818e4-6792-4499-aa84-8ad5cc852465 for instance 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 on hv-cinder-82301 Jan 19 13:04:53.250963 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-8e45771b-296e-4398-a198-659d78176a86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:53.251674 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-8e45771b-296e-4398-a198-659d78176a86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:53.263076 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8e45771b-296e-4398-a198-659d78176a86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:53.263531 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8e45771b-296e-4398-a198-659d78176a86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:53.265249 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-27c4b6c6-496e-4b4b-96b2-86049607191d req-f2ce5a32-46a4-464f-917b-4ced88f5a29e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052460 Jan 19 13:04:53.265849 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 45/97] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:04:53.267059 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8e45771b-296e-4398-a198-659d78176a86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:53.267659 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8e45771b-296e-4398-a198-659d78176a86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:53.321231 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-021d5d97-3dcd-45c0-b9a6-01fffcb770c6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:53.322361 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-021d5d97-3dcd-45c0-b9a6-01fffcb770c6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:53.329231 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-021d5d97-3dcd-45c0-b9a6-01fffcb770c6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:53.329754 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-021d5d97-3dcd-45c0-b9a6-01fffcb770c6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:53.330600 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-021d5d97-3dcd-45c0-b9a6-01fffcb770c6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:53.331101 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-021d5d97-3dcd-45c0-b9a6-01fffcb770c6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:53.438851 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-8e45771b-296e-4398-a198-659d78176a86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:53.447381 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-8e45771b-296e-4398-a198-659d78176a86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:53.448966 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-8e45771b-296e-4398-a198-659d78176a86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:53.450070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-8e45771b-296e-4398-a198-659d78176a86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.202930 Jan 19 13:04:53.450626 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 53/98] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:53 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:04:53.500940 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-021d5d97-3dcd-45c0-b9a6-01fffcb770c6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:53.510390 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-021d5d97-3dcd-45c0-b9a6-01fffcb770c6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.193352 Jan 19 13:04:53.512326 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 46/99] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:53 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:53.535552 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-96cbc080-05e1-47dd-a320-503a6886ff29 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:53.536420 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-96cbc080-05e1-47dd-a320-503a6886ff29 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:53.546736 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-96cbc080-05e1-47dd-a320-503a6886ff29 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:53.547270 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-96cbc080-05e1-47dd-a320-503a6886ff29 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:53.548530 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-96cbc080-05e1-47dd-a320-503a6886ff29 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:53.548968 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-96cbc080-05e1-47dd-a320-503a6886ff29 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:53.948019 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-81c6a320-2346-411e-a6d2-6e4ebab8173b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:53.948675 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-81c6a320-2346-411e-a6d2-6e4ebab8173b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:53.954979 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-81c6a320-2346-411e-a6d2-6e4ebab8173b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:53.956043 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-81c6a320-2346-411e-a6d2-6e4ebab8173b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:53.957026 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-81c6a320-2346-411e-a6d2-6e4ebab8173b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:53.957602 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-81c6a320-2346-411e-a6d2-6e4ebab8173b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:54.070694 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-96cbc080-05e1-47dd-a320-503a6886ff29 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:54.079482 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-96cbc080-05e1-47dd-a320-503a6886ff29 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.547724 Jan 19 13:04:54.080152 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 54/100] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:53 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:54.149665 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-81c6a320-2346-411e-a6d2-6e4ebab8173b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:54.157626 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-81c6a320-2346-411e-a6d2-6e4ebab8173b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.213884 Jan 19 13:04:54.158261 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 47/101] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:53 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:54.467902 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-cf8a85bc-03da-4cb5-aa57-fe54849e48a7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:54.468535 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-cf8a85bc-03da-4cb5-aa57-fe54849e48a7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:54.475008 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf8a85bc-03da-4cb5-aa57-fe54849e48a7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:54.475458 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf8a85bc-03da-4cb5-aa57-fe54849e48a7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:54.476261 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf8a85bc-03da-4cb5-aa57-fe54849e48a7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:54.476698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf8a85bc-03da-4cb5-aa57-fe54849e48a7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:54.529624 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-686b83c4-e01f-468d-aa56-d91a59079e5c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:54.530945 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-686b83c4-e01f-468d-aa56-d91a59079e5c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:54.537946 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-686b83c4-e01f-468d-aa56-d91a59079e5c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:54.538683 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-686b83c4-e01f-468d-aa56-d91a59079e5c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:54.539555 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-686b83c4-e01f-468d-aa56-d91a59079e5c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:54.539955 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-686b83c4-e01f-468d-aa56-d91a59079e5c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:54.783955 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-cf8a85bc-03da-4cb5-aa57-fe54849e48a7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:54.792477 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-cf8a85bc-03da-4cb5-aa57-fe54849e48a7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:54.793977 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-cf8a85bc-03da-4cb5-aa57-fe54849e48a7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:54.795064 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-cf8a85bc-03da-4cb5-aa57-fe54849e48a7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.330791 Jan 19 13:04:54.795612 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 55/102] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:54 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:04:54.846807 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-686b83c4-e01f-468d-aa56-d91a59079e5c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:54.854691 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-686b83c4-e01f-468d-aa56-d91a59079e5c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.329250 Jan 19 13:04:54.855267 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 48/103] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:54 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:55.096352 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-bb100ff8-edc5-45c8-9076-9b65d24adcca tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:55.096955 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-bb100ff8-edc5-45c8-9076-9b65d24adcca tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:55.104188 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bb100ff8-edc5-45c8-9076-9b65d24adcca tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:55.104665 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bb100ff8-edc5-45c8-9076-9b65d24adcca tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:55.105445 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bb100ff8-edc5-45c8-9076-9b65d24adcca tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:55.105881 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bb100ff8-edc5-45c8-9076-9b65d24adcca tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:55.174488 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4e73b8f3-b2a9-4221-af89-af07292609a7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:55.175122 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4e73b8f3-b2a9-4221-af89-af07292609a7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:55.181981 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4e73b8f3-b2a9-4221-af89-af07292609a7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:55.182460 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4e73b8f3-b2a9-4221-af89-af07292609a7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:55.183245 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4e73b8f3-b2a9-4221-af89-af07292609a7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:55.183683 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4e73b8f3-b2a9-4221-af89-af07292609a7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:55.264785 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bb100ff8-edc5-45c8-9076-9b65d24adcca tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:55.272900 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-bb100ff8-edc5-45c8-9076-9b65d24adcca tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.180115 Jan 19 13:04:55.273497 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 56/104] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:55 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:55.331320 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4e73b8f3-b2a9-4221-af89-af07292609a7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:55.339187 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4e73b8f3-b2a9-4221-af89-af07292609a7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.168382 Jan 19 13:04:55.339751 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 49/105] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:55 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:55.813545 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b7f35d30-2516-43ec-8dd5-b62057f0d9fe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:55.814145 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b7f35d30-2516-43ec-8dd5-b62057f0d9fe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:55.820848 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b7f35d30-2516-43ec-8dd5-b62057f0d9fe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:55.821297 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b7f35d30-2516-43ec-8dd5-b62057f0d9fe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:55.822061 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b7f35d30-2516-43ec-8dd5-b62057f0d9fe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:55.822497 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b7f35d30-2516-43ec-8dd5-b62057f0d9fe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:55.870426 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f57f11f4-e20c-4ba4-9a25-e915aab91904 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:55.871034 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f57f11f4-e20c-4ba4-9a25-e915aab91904 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:55.876954 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f57f11f4-e20c-4ba4-9a25-e915aab91904 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:55.877404 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f57f11f4-e20c-4ba4-9a25-e915aab91904 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:55.878182 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f57f11f4-e20c-4ba4-9a25-e915aab91904 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:55.878616 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f57f11f4-e20c-4ba4-9a25-e915aab91904 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:55.977712 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b7f35d30-2516-43ec-8dd5-b62057f0d9fe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:55.985434 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b7f35d30-2516-43ec-8dd5-b62057f0d9fe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:55.986935 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b7f35d30-2516-43ec-8dd5-b62057f0d9fe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:55.988063 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b7f35d30-2516-43ec-8dd5-b62057f0d9fe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.178194 Jan 19 13:04:55.988623 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 57/106] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:55 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:04:56.042160 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f57f11f4-e20c-4ba4-9a25-e915aab91904 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:56.049365 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f57f11f4-e20c-4ba4-9a25-e915aab91904 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.182557 Jan 19 13:04:56.049930 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 50/107] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:55 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:56.289541 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c08d14a8-bf74-454b-9cb6-dc785d909c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:56.290062 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c08d14a8-bf74-454b-9cb6-dc785d909c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:56.295825 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c08d14a8-bf74-454b-9cb6-dc785d909c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:56.296300 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c08d14a8-bf74-454b-9cb6-dc785d909c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:56.297063 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c08d14a8-bf74-454b-9cb6-dc785d909c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:56.297493 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c08d14a8-bf74-454b-9cb6-dc785d909c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:56.355660 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4b920fe2-a7ee-4016-ad19-3fd1dd702762 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:56.356293 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4b920fe2-a7ee-4016-ad19-3fd1dd702762 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:56.361963 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4b920fe2-a7ee-4016-ad19-3fd1dd702762 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:56.362403 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4b920fe2-a7ee-4016-ad19-3fd1dd702762 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:56.363196 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4b920fe2-a7ee-4016-ad19-3fd1dd702762 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:56.363628 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4b920fe2-a7ee-4016-ad19-3fd1dd702762 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:56.459376 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c08d14a8-bf74-454b-9cb6-dc785d909c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:56.466528 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c08d14a8-bf74-454b-9cb6-dc785d909c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.181264 Jan 19 13:04:56.467092 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 58/108] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:56 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:56.519484 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4b920fe2-a7ee-4016-ad19-3fd1dd702762 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:56.526968 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4b920fe2-a7ee-4016-ad19-3fd1dd702762 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.175082 Jan 19 13:04:56.527527 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 51/109] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:56 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:57.006654 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-18905df3-65d2-4d28-96f3-969f8b2df414 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:57.007361 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-18905df3-65d2-4d28-96f3-969f8b2df414 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:57.015551 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-18905df3-65d2-4d28-96f3-969f8b2df414 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:57.016301 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-18905df3-65d2-4d28-96f3-969f8b2df414 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:57.017327 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-18905df3-65d2-4d28-96f3-969f8b2df414 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:57.017968 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-18905df3-65d2-4d28-96f3-969f8b2df414 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:57.067025 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-330f9c55-bcbb-4a20-a4fc-2048fda25023 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:57.068295 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-330f9c55-bcbb-4a20-a4fc-2048fda25023 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:57.074220 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-330f9c55-bcbb-4a20-a4fc-2048fda25023 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:57.074785 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-330f9c55-bcbb-4a20-a4fc-2048fda25023 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:57.075655 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-330f9c55-bcbb-4a20-a4fc-2048fda25023 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:57.076290 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-330f9c55-bcbb-4a20-a4fc-2048fda25023 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:57.661463 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-18905df3-65d2-4d28-96f3-969f8b2df414 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:57.669621 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-18905df3-65d2-4d28-96f3-969f8b2df414 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:57.671169 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-330f9c55-bcbb-4a20-a4fc-2048fda25023 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:57.671390 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-18905df3-65d2-4d28-96f3-969f8b2df414 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:57.673362 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-18905df3-65d2-4d28-96f3-969f8b2df414 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.671069 Jan 19 13:04:57.684926 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 59/110] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:57 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:04:57.689317 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-330f9c55-bcbb-4a20-a4fc-2048fda25023 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.625645 Jan 19 13:04:57.689698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-99fc5bb9-13a4-4233-b4bc-7afd7c68ce92 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:57.690017 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 52/111] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:57 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:57.690298 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-99fc5bb9-13a4-4233-b4bc-7afd7c68ce92 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:57.695952 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-cbf13d18-1b84-4a2c-8779-9e2af1a3038b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:57.696855 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-cbf13d18-1b84-4a2c-8779-9e2af1a3038b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:57.697072 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-99fc5bb9-13a4-4233-b4bc-7afd7c68ce92 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:57.697436 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-99fc5bb9-13a4-4233-b4bc-7afd7c68ce92 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:57.698228 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-99fc5bb9-13a4-4233-b4bc-7afd7c68ce92 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:57.698670 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-99fc5bb9-13a4-4233-b4bc-7afd7c68ce92 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:57.706367 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cbf13d18-1b84-4a2c-8779-9e2af1a3038b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:57.706895 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cbf13d18-1b84-4a2c-8779-9e2af1a3038b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:57.707747 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cbf13d18-1b84-4a2c-8779-9e2af1a3038b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:57.708314 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cbf13d18-1b84-4a2c-8779-9e2af1a3038b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:58.266485 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-cbf13d18-1b84-4a2c-8779-9e2af1a3038b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:58.269692 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-99fc5bb9-13a4-4233-b4bc-7afd7c68ce92 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:58.274456 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-cbf13d18-1b84-4a2c-8779-9e2af1a3038b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.583087 Jan 19 13:04:58.275028 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 53/112] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:57 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:58.277522 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-99fc5bb9-13a4-4233-b4bc-7afd7c68ce92 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.591384 Jan 19 13:04:58.278082 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 60/113] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:57 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:58.691995 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4d3f7144-ad51-4147-8314-b13965ede610 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:58.694987 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4d3f7144-ad51-4147-8314-b13965ede610 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:58.700988 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4d3f7144-ad51-4147-8314-b13965ede610 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:58.706779 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5bad8558-1c58-4d0e-8a64-4614bd79e495 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:58.707381 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5bad8558-1c58-4d0e-8a64-4614bd79e495 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:58.710666 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4d3f7144-ad51-4147-8314-b13965ede610 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:58.711497 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4d3f7144-ad51-4147-8314-b13965ede610 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:58.711939 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4d3f7144-ad51-4147-8314-b13965ede610 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:58.715519 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5bad8558-1c58-4d0e-8a64-4614bd79e495 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:58.715973 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5bad8558-1c58-4d0e-8a64-4614bd79e495 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:58.716992 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5bad8558-1c58-4d0e-8a64-4614bd79e495 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:58.717484 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5bad8558-1c58-4d0e-8a64-4614bd79e495 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:58.916458 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4d3f7144-ad51-4147-8314-b13965ede610 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:58.919720 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5bad8558-1c58-4d0e-8a64-4614bd79e495 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:58.924799 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4d3f7144-ad51-4147-8314-b13965ede610 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:58.926530 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4d3f7144-ad51-4147-8314-b13965ede610 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:58.935875 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5bad8558-1c58-4d0e-8a64-4614bd79e495 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.224489 Jan 19 13:04:58.935875 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 61/114] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:58 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:58.936044 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4d3f7144-ad51-4147-8314-b13965ede610 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.240717 Jan 19 13:04:58.936044 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 54/115] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:58 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:04:59.291735 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-60ed0eec-8e74-48b0-b8d5-d752c575d9bd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:59.292402 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-60ed0eec-8e74-48b0-b8d5-d752c575d9bd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:59.293243 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6ffd1018-bed7-4e97-90b0-024d8ecbe22b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:59.293857 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6ffd1018-bed7-4e97-90b0-024d8ecbe22b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:59.298187 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-60ed0eec-8e74-48b0-b8d5-d752c575d9bd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:59.298633 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-60ed0eec-8e74-48b0-b8d5-d752c575d9bd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:59.299398 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-60ed0eec-8e74-48b0-b8d5-d752c575d9bd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:59.299663 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6ffd1018-bed7-4e97-90b0-024d8ecbe22b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:59.299825 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-60ed0eec-8e74-48b0-b8d5-d752c575d9bd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:59.300155 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6ffd1018-bed7-4e97-90b0-024d8ecbe22b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:59.300981 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6ffd1018-bed7-4e97-90b0-024d8ecbe22b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:59.301373 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6ffd1018-bed7-4e97-90b0-024d8ecbe22b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:59.493644 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-60ed0eec-8e74-48b0-b8d5-d752c575d9bd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:59.496864 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6ffd1018-bed7-4e97-90b0-024d8ecbe22b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:04:59.501107 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-60ed0eec-8e74-48b0-b8d5-d752c575d9bd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.213037 Jan 19 13:04:59.501758 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 62/116] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:59 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:04:59.504178 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6ffd1018-bed7-4e97-90b0-024d8ecbe22b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.214420 Jan 19 13:04:59.509033 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 55/117] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:59 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:04:59.944219 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-68449e53-2b70-4ca3-b5af-658a7b6042c4 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:59.944831 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-68449e53-2b70-4ca3-b5af-658a7b6042c4 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:59.946070 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8d80544a-534b-417a-9d29-19210cb49f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:04:59.946665 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8d80544a-534b-417a-9d29-19210cb49f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:04:59.950856 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-68449e53-2b70-4ca3-b5af-658a7b6042c4 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:59.951307 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-68449e53-2b70-4ca3-b5af-658a7b6042c4 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:59.952112 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-68449e53-2b70-4ca3-b5af-658a7b6042c4 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:59.952384 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8d80544a-534b-417a-9d29-19210cb49f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:59.952556 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-68449e53-2b70-4ca3-b5af-658a7b6042c4 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:59.952830 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8d80544a-534b-417a-9d29-19210cb49f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:04:59.953589 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8d80544a-534b-417a-9d29-19210cb49f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:04:59.954012 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8d80544a-534b-417a-9d29-19210cb49f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:00.145119 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-68449e53-2b70-4ca3-b5af-658a7b6042c4 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:00.152307 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-68449e53-2b70-4ca3-b5af-658a7b6042c4 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.212030 Jan 19 13:05:00.153067 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 63/118] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:04:59 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:00.153266 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-8d80544a-534b-417a-9d29-19210cb49f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:00.162040 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-8d80544a-534b-417a-9d29-19210cb49f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:00.163712 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-8d80544a-534b-417a-9d29-19210cb49f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:00.164911 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8d80544a-534b-417a-9d29-19210cb49f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.222747 Jan 19 13:05:00.165529 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 56/119] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:04:59 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:00.518364 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a0d01761-2ddb-40aa-8cbb-8e1560a7bd7d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:00.518974 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a0d01761-2ddb-40aa-8cbb-8e1560a7bd7d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:00.522594 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-32da4b64-9859-482e-a8b1-00e9a49ec9c8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:00.523226 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-32da4b64-9859-482e-a8b1-00e9a49ec9c8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:00.525582 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a0d01761-2ddb-40aa-8cbb-8e1560a7bd7d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:00.526067 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a0d01761-2ddb-40aa-8cbb-8e1560a7bd7d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:00.526849 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a0d01761-2ddb-40aa-8cbb-8e1560a7bd7d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:00.527413 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a0d01761-2ddb-40aa-8cbb-8e1560a7bd7d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:00.530449 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32da4b64-9859-482e-a8b1-00e9a49ec9c8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:00.530928 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32da4b64-9859-482e-a8b1-00e9a49ec9c8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:00.531815 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32da4b64-9859-482e-a8b1-00e9a49ec9c8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:00.532283 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32da4b64-9859-482e-a8b1-00e9a49ec9c8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:00.733626 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a0d01761-2ddb-40aa-8cbb-8e1560a7bd7d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:00.740987 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-32da4b64-9859-482e-a8b1-00e9a49ec9c8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:00.741414 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a0d01761-2ddb-40aa-8cbb-8e1560a7bd7d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.226570 Jan 19 13:05:00.742149 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 64/120] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:00 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:00.748552 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-32da4b64-9859-482e-a8b1-00e9a49ec9c8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.229979 Jan 19 13:05:00.749563 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 57/121] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:00 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:01.169187 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-da9662de-2351-46a1-b512-c89a29c66f8f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:01.169818 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-da9662de-2351-46a1-b512-c89a29c66f8f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:01.175615 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da9662de-2351-46a1-b512-c89a29c66f8f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:01.176121 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da9662de-2351-46a1-b512-c89a29c66f8f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:01.178963 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da9662de-2351-46a1-b512-c89a29c66f8f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:01.179413 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da9662de-2351-46a1-b512-c89a29c66f8f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:01.182501 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f9b2fe58-8918-46eb-b3ea-6e19188fb186 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:01.185605 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f9b2fe58-8918-46eb-b3ea-6e19188fb186 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:01.191542 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f9b2fe58-8918-46eb-b3ea-6e19188fb186 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:01.192013 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f9b2fe58-8918-46eb-b3ea-6e19188fb186 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:01.193666 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f9b2fe58-8918-46eb-b3ea-6e19188fb186 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:01.194096 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f9b2fe58-8918-46eb-b3ea-6e19188fb186 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:01.378353 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-da9662de-2351-46a1-b512-c89a29c66f8f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:01.382634 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f9b2fe58-8918-46eb-b3ea-6e19188fb186 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:01.386973 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-da9662de-2351-46a1-b512-c89a29c66f8f tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.221413 Jan 19 13:05:01.387736 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 65/122] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:01 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:01.390820 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f9b2fe58-8918-46eb-b3ea-6e19188fb186 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:01.392374 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f9b2fe58-8918-46eb-b3ea-6e19188fb186 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:01.393464 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f9b2fe58-8918-46eb-b3ea-6e19188fb186 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.214525 Jan 19 13:05:01.394009 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 58/123] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:01 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:05:01.758134 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7bd43791-23a3-4875-bd88-8af637c7ddfe tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:01.758660 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7bd43791-23a3-4875-bd88-8af637c7ddfe tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:01.764865 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7bd43791-23a3-4875-bd88-8af637c7ddfe tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:01.765318 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7bd43791-23a3-4875-bd88-8af637c7ddfe tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:01.766095 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7bd43791-23a3-4875-bd88-8af637c7ddfe tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:01.766195 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7da0c942-9221-4bb8-98b6-ab1e3a102c73 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:01.766597 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7bd43791-23a3-4875-bd88-8af637c7ddfe tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:01.767100 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7da0c942-9221-4bb8-98b6-ab1e3a102c73 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:01.773752 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7da0c942-9221-4bb8-98b6-ab1e3a102c73 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:01.774203 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7da0c942-9221-4bb8-98b6-ab1e3a102c73 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:01.774979 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7da0c942-9221-4bb8-98b6-ab1e3a102c73 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:01.775413 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7da0c942-9221-4bb8-98b6-ab1e3a102c73 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:01.962877 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7bd43791-23a3-4875-bd88-8af637c7ddfe tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:01.970500 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7bd43791-23a3-4875-bd88-8af637c7ddfe tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.216231 Jan 19 13:05:01.971069 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 66/124] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:01 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:01.977118 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-7da0c942-9221-4bb8-98b6-ab1e3a102c73 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:01.984306 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7da0c942-9221-4bb8-98b6-ab1e3a102c73 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.222227 Jan 19 13:05:01.984859 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 59/125] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:01 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:02.404783 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-81b66843-0216-4125-bc37-db9f734049b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:02.405315 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-81b66843-0216-4125-bc37-db9f734049b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:02.412869 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-81b66843-0216-4125-bc37-db9f734049b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:02.413384 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-81b66843-0216-4125-bc37-db9f734049b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:02.414341 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-81b66843-0216-4125-bc37-db9f734049b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:02.415001 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-81b66843-0216-4125-bc37-db9f734049b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:02.416026 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1ba13c3c-a485-4a4e-bce8-4958e7ef92b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:02.416696 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1ba13c3c-a485-4a4e-bce8-4958e7ef92b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:02.422800 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1ba13c3c-a485-4a4e-bce8-4958e7ef92b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:02.423235 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1ba13c3c-a485-4a4e-bce8-4958e7ef92b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:02.424021 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1ba13c3c-a485-4a4e-bce8-4958e7ef92b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:02.424456 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1ba13c3c-a485-4a4e-bce8-4958e7ef92b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:02.704323 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-81b66843-0216-4125-bc37-db9f734049b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:02.712321 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-81b66843-0216-4125-bc37-db9f734049b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.311340 Jan 19 13:05:02.712891 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 67/126] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:02 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:02.734511 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-1ba13c3c-a485-4a4e-bce8-4958e7ef92b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:02.742715 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-1ba13c3c-a485-4a4e-bce8-4958e7ef92b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:02.744236 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-1ba13c3c-a485-4a4e-bce8-4958e7ef92b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:02.745321 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1ba13c3c-a485-4a4e-bce8-4958e7ef92b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.334134 Jan 19 13:05:02.745866 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 60/127] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:02 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:05:02.987607 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-88aff515-8128-43ab-aea0-75bc5479ac52 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:02.988240 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-88aff515-8128-43ab-aea0-75bc5479ac52 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:02.994653 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-88aff515-8128-43ab-aea0-75bc5479ac52 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:02.995120 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-88aff515-8128-43ab-aea0-75bc5479ac52 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:02.996066 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-88aff515-8128-43ab-aea0-75bc5479ac52 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:02.996675 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-88aff515-8128-43ab-aea0-75bc5479ac52 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:03.000850 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-dc2d3c6d-feb6-4d38-a606-11dab2f2f106 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:03.001451 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-dc2d3c6d-feb6-4d38-a606-11dab2f2f106 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:03.008494 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dc2d3c6d-feb6-4d38-a606-11dab2f2f106 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:03.008947 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dc2d3c6d-feb6-4d38-a606-11dab2f2f106 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:03.009725 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dc2d3c6d-feb6-4d38-a606-11dab2f2f106 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:03.010161 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dc2d3c6d-feb6-4d38-a606-11dab2f2f106 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:03.243560 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-88aff515-8128-43ab-aea0-75bc5479ac52 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:03.250793 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-88aff515-8128-43ab-aea0-75bc5479ac52 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.266829 Jan 19 13:05:03.251575 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 68/128] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:02 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:03.254434 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-dc2d3c6d-feb6-4d38-a606-11dab2f2f106 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:03.262445 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-dc2d3c6d-feb6-4d38-a606-11dab2f2f106 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.265275 Jan 19 13:05:03.263252 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 61/129] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:02 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:03.729090 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-aa387b59-401f-4e11-a4dc-9584228a54bd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:03.729717 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-aa387b59-401f-4e11-a4dc-9584228a54bd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:03.735718 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa387b59-401f-4e11-a4dc-9584228a54bd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:03.736197 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa387b59-401f-4e11-a4dc-9584228a54bd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:03.736970 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa387b59-401f-4e11-a4dc-9584228a54bd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:03.737405 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa387b59-401f-4e11-a4dc-9584228a54bd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:03.766722 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e1bbd078-d272-4d50-ad4f-9dd578ac6f6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:03.767449 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e1bbd078-d272-4d50-ad4f-9dd578ac6f6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:03.774812 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e1bbd078-d272-4d50-ad4f-9dd578ac6f6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:03.775367 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e1bbd078-d272-4d50-ad4f-9dd578ac6f6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:03.776487 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e1bbd078-d272-4d50-ad4f-9dd578ac6f6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:03.777127 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e1bbd078-d272-4d50-ad4f-9dd578ac6f6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:03.938834 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-aa387b59-401f-4e11-a4dc-9584228a54bd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:03.946173 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-aa387b59-401f-4e11-a4dc-9584228a54bd tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.221552 Jan 19 13:05:03.946740 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 69/130] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:03 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:03.963737 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e1bbd078-d272-4d50-ad4f-9dd578ac6f6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:03.971399 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e1bbd078-d272-4d50-ad4f-9dd578ac6f6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:03.972946 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e1bbd078-d272-4d50-ad4f-9dd578ac6f6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:03.974586 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e1bbd078-d272-4d50-ad4f-9dd578ac6f6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.212485 Jan 19 13:05:03.975165 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 62/131] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:03 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:04.268428 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3ec76c23-6946-46c0-9dfb-75181c1e0474 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:04.269032 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3ec76c23-6946-46c0-9dfb-75181c1e0474 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:04.275074 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3ec76c23-6946-46c0-9dfb-75181c1e0474 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:04.275550 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3ec76c23-6946-46c0-9dfb-75181c1e0474 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:04.276362 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3ec76c23-6946-46c0-9dfb-75181c1e0474 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:04.276805 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3ec76c23-6946-46c0-9dfb-75181c1e0474 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:04.278768 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6380353e-c5dc-4250-9a58-b3133294de30 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:04.279376 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6380353e-c5dc-4250-9a58-b3133294de30 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:04.285161 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6380353e-c5dc-4250-9a58-b3133294de30 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:04.285613 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6380353e-c5dc-4250-9a58-b3133294de30 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:04.286540 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6380353e-c5dc-4250-9a58-b3133294de30 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:04.286978 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6380353e-c5dc-4250-9a58-b3133294de30 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:04.465132 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3ec76c23-6946-46c0-9dfb-75181c1e0474 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:04.468484 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6380353e-c5dc-4250-9a58-b3133294de30 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:04.472805 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3ec76c23-6946-46c0-9dfb-75181c1e0474 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.208018 Jan 19 13:05:04.473517 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 70/132] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:04 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:04.475784 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6380353e-c5dc-4250-9a58-b3133294de30 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.200685 Jan 19 13:05:04.476374 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 63/133] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:04 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:04.962577 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-34b53515-9c6d-457c-a200-0f9178e39c0c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:04.963297 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-34b53515-9c6d-457c-a200-0f9178e39c0c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:04.969266 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-34b53515-9c6d-457c-a200-0f9178e39c0c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:04.969714 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-34b53515-9c6d-457c-a200-0f9178e39c0c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:04.970486 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-34b53515-9c6d-457c-a200-0f9178e39c0c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:04.970920 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-34b53515-9c6d-457c-a200-0f9178e39c0c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:04.991866 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7d46572b-7940-40ce-8660-825a01608d36 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:04.992497 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7d46572b-7940-40ce-8660-825a01608d36 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:04.998220 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d46572b-7940-40ce-8660-825a01608d36 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:04.998667 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d46572b-7940-40ce-8660-825a01608d36 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:04.999438 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d46572b-7940-40ce-8660-825a01608d36 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:04.999874 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d46572b-7940-40ce-8660-825a01608d36 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:05.160626 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-34b53515-9c6d-457c-a200-0f9178e39c0c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:05.168287 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-34b53515-9c6d-457c-a200-0f9178e39c0c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.210298 Jan 19 13:05:05.168851 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 71/134] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:04 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:05.175272 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-7d46572b-7940-40ce-8660-825a01608d36 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:05.183299 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-7d46572b-7940-40ce-8660-825a01608d36 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:05.184818 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-7d46572b-7940-40ce-8660-825a01608d36 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:05.185894 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7d46572b-7940-40ce-8660-825a01608d36 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.197819 Jan 19 13:05:05.186432 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 64/135] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:04 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:05.489935 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f7a4dc94-8dd2-4452-b617-36429f6da147 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:05.490535 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f7a4dc94-8dd2-4452-b617-36429f6da147 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:05.492192 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5925a3e6-9044-4f4b-acdc-0828108abd9e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:05.492802 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5925a3e6-9044-4f4b-acdc-0828108abd9e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:05.496983 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f7a4dc94-8dd2-4452-b617-36429f6da147 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:05.497441 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f7a4dc94-8dd2-4452-b617-36429f6da147 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:05.498216 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f7a4dc94-8dd2-4452-b617-36429f6da147 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:05.498574 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5925a3e6-9044-4f4b-acdc-0828108abd9e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:05.498673 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f7a4dc94-8dd2-4452-b617-36429f6da147 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:05.499027 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5925a3e6-9044-4f4b-acdc-0828108abd9e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:05.499818 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5925a3e6-9044-4f4b-acdc-0828108abd9e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:05.500274 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5925a3e6-9044-4f4b-acdc-0828108abd9e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:05.710959 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5925a3e6-9044-4f4b-acdc-0828108abd9e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:05.714569 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f7a4dc94-8dd2-4452-b617-36429f6da147 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:05.719375 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5925a3e6-9044-4f4b-acdc-0828108abd9e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.231080 Jan 19 13:05:05.719961 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 65/136] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:05 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:05.723871 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f7a4dc94-8dd2-4452-b617-36429f6da147 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.238066 Jan 19 13:05:05.724609 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 72/137] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:05 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:06.185410 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4306e3e1-b9ad-4104-9e5d-916454e48077 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:06.185966 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4306e3e1-b9ad-4104-9e5d-916454e48077 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:06.192004 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4306e3e1-b9ad-4104-9e5d-916454e48077 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:06.192519 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4306e3e1-b9ad-4104-9e5d-916454e48077 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:06.193367 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4306e3e1-b9ad-4104-9e5d-916454e48077 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:06.193809 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4306e3e1-b9ad-4104-9e5d-916454e48077 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:06.203567 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-af2791d9-8af7-4e63-bf83-737f1e508a49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:06.204217 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-af2791d9-8af7-4e63-bf83-737f1e508a49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:06.210265 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-af2791d9-8af7-4e63-bf83-737f1e508a49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:06.210725 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-af2791d9-8af7-4e63-bf83-737f1e508a49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:06.211486 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-af2791d9-8af7-4e63-bf83-737f1e508a49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:06.211911 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-af2791d9-8af7-4e63-bf83-737f1e508a49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:06.394538 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4306e3e1-b9ad-4104-9e5d-916454e48077 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:06.398165 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-af2791d9-8af7-4e63-bf83-737f1e508a49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:06.403513 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4306e3e1-b9ad-4104-9e5d-916454e48077 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.221869 Jan 19 13:05:06.404111 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 66/138] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:06 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:06.405844 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-af2791d9-8af7-4e63-bf83-737f1e508a49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:06.407498 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-af2791d9-8af7-4e63-bf83-737f1e508a49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:06.408621 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-af2791d9-8af7-4e63-bf83-737f1e508a49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.208697 Jan 19 13:05:06.409283 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 73/139] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:06 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:06.736345 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-05f61b92-6c29-4d14-8d63-732ce00d4d02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:06.736920 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-05f61b92-6c29-4d14-8d63-732ce00d4d02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:06.740519 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-443915df-ef2e-47b3-a09d-cfbe07eff2f2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:06.741120 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-443915df-ef2e-47b3-a09d-cfbe07eff2f2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:06.743435 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05f61b92-6c29-4d14-8d63-732ce00d4d02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:06.743891 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05f61b92-6c29-4d14-8d63-732ce00d4d02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:06.744695 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05f61b92-6c29-4d14-8d63-732ce00d4d02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:06.745137 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05f61b92-6c29-4d14-8d63-732ce00d4d02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:06.746810 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-443915df-ef2e-47b3-a09d-cfbe07eff2f2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:06.747260 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-443915df-ef2e-47b3-a09d-cfbe07eff2f2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:06.748063 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-443915df-ef2e-47b3-a09d-cfbe07eff2f2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:06.748504 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-443915df-ef2e-47b3-a09d-cfbe07eff2f2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:06.994763 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-05f61b92-6c29-4d14-8d63-732ce00d4d02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:07.000691 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-443915df-ef2e-47b3-a09d-cfbe07eff2f2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:07.002679 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-05f61b92-6c29-4d14-8d63-732ce00d4d02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.269688 Jan 19 13:05:07.003459 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 67/140] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:06 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:07.021148 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-443915df-ef2e-47b3-a09d-cfbe07eff2f2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.283818 Jan 19 13:05:07.022196 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 74/141] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:06 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:07.428299 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ce7ee087-03c7-4464-b2f3-22625e173357 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:07.428909 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ce7ee087-03c7-4464-b2f3-22625e173357 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:07.429749 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-bd81fae8-4b3d-4104-8344-17e1e3fedb98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:07.430482 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-bd81fae8-4b3d-4104-8344-17e1e3fedb98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:07.434823 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ce7ee087-03c7-4464-b2f3-22625e173357 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:07.435274 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ce7ee087-03c7-4464-b2f3-22625e173357 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:07.436102 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ce7ee087-03c7-4464-b2f3-22625e173357 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:07.436284 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bd81fae8-4b3d-4104-8344-17e1e3fedb98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:07.436539 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ce7ee087-03c7-4464-b2f3-22625e173357 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:07.436718 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bd81fae8-4b3d-4104-8344-17e1e3fedb98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:07.437499 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bd81fae8-4b3d-4104-8344-17e1e3fedb98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:07.437936 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bd81fae8-4b3d-4104-8344-17e1e3fedb98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:07.629174 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ce7ee087-03c7-4464-b2f3-22625e173357 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:07.633025 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bd81fae8-4b3d-4104-8344-17e1e3fedb98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:07.637230 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ce7ee087-03c7-4464-b2f3-22625e173357 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.212839 Jan 19 13:05:07.638056 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 68/142] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:07 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:07.641093 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bd81fae8-4b3d-4104-8344-17e1e3fedb98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:07.642583 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bd81fae8-4b3d-4104-8344-17e1e3fedb98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:07.643658 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-bd81fae8-4b3d-4104-8344-17e1e3fedb98 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.217628 Jan 19 13:05:07.644231 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 75/143] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:07 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:08.021302 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b76e5e7f-6d1b-4817-b582-b7babdb4f50c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:08.021905 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b76e5e7f-6d1b-4817-b582-b7babdb4f50c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:08.027702 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b76e5e7f-6d1b-4817-b582-b7babdb4f50c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:08.028184 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b76e5e7f-6d1b-4817-b582-b7babdb4f50c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:08.028950 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b76e5e7f-6d1b-4817-b582-b7babdb4f50c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:08.029379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b76e5e7f-6d1b-4817-b582-b7babdb4f50c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:08.037902 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3fdcb046-56ba-4d10-a8a0-3969c80dd2ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:08.038508 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3fdcb046-56ba-4d10-a8a0-3969c80dd2ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:08.044293 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3fdcb046-56ba-4d10-a8a0-3969c80dd2ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:08.044751 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3fdcb046-56ba-4d10-a8a0-3969c80dd2ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:08.045534 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3fdcb046-56ba-4d10-a8a0-3969c80dd2ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:08.045970 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3fdcb046-56ba-4d10-a8a0-3969c80dd2ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:08.224228 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b76e5e7f-6d1b-4817-b582-b7babdb4f50c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:08.226841 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3fdcb046-56ba-4d10-a8a0-3969c80dd2ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:08.231528 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b76e5e7f-6d1b-4817-b582-b7babdb4f50c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.214401 Jan 19 13:05:08.232318 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 69/144] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:08 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:08.234066 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3fdcb046-56ba-4d10-a8a0-3969c80dd2ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.200353 Jan 19 13:05:08.234620 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 76/145] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:08 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:08.654004 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1a0618a8-ff75-4cda-86f2-0c6ba0a98664 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:08.654612 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1a0618a8-ff75-4cda-86f2-0c6ba0a98664 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:08.661875 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0903e914-7f88-4b85-8f00-c2802cdc77f1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:08.662043 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1a0618a8-ff75-4cda-86f2-0c6ba0a98664 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:08.662567 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1a0618a8-ff75-4cda-86f2-0c6ba0a98664 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:08.663004 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0903e914-7f88-4b85-8f00-c2802cdc77f1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:08.663862 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1a0618a8-ff75-4cda-86f2-0c6ba0a98664 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:08.664612 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1a0618a8-ff75-4cda-86f2-0c6ba0a98664 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:08.670341 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0903e914-7f88-4b85-8f00-c2802cdc77f1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:08.670878 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0903e914-7f88-4b85-8f00-c2802cdc77f1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:08.671747 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0903e914-7f88-4b85-8f00-c2802cdc77f1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:08.672331 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0903e914-7f88-4b85-8f00-c2802cdc77f1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:08.871336 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-1a0618a8-ff75-4cda-86f2-0c6ba0a98664 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:08.876395 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0903e914-7f88-4b85-8f00-c2802cdc77f1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:08.880221 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1a0618a8-ff75-4cda-86f2-0c6ba0a98664 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.229572 Jan 19 13:05:08.880795 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 70/146] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:08 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:08.885260 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0903e914-7f88-4b85-8f00-c2802cdc77f1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:08.886837 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0903e914-7f88-4b85-8f00-c2802cdc77f1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:08.888282 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0903e914-7f88-4b85-8f00-c2802cdc77f1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.230598 Jan 19 13:05:08.898370 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 77/147] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:08 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:09.247816 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ea1be477-d03d-4d98-af97-e805c4d061e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:09.248444 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ea1be477-d03d-4d98-af97-e805c4d061e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:09.250138 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c22ad688-cd0d-411c-9452-55944df671d0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:09.250734 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c22ad688-cd0d-411c-9452-55944df671d0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:09.254806 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ea1be477-d03d-4d98-af97-e805c4d061e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:09.255415 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ea1be477-d03d-4d98-af97-e805c4d061e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:09.256223 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ea1be477-d03d-4d98-af97-e805c4d061e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:09.256429 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c22ad688-cd0d-411c-9452-55944df671d0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:09.256674 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ea1be477-d03d-4d98-af97-e805c4d061e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:09.256883 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c22ad688-cd0d-411c-9452-55944df671d0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:09.257662 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c22ad688-cd0d-411c-9452-55944df671d0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:09.258087 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c22ad688-cd0d-411c-9452-55944df671d0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:09.453575 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ea1be477-d03d-4d98-af97-e805c4d061e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:09.457149 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c22ad688-cd0d-411c-9452-55944df671d0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:09.461823 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ea1be477-d03d-4d98-af97-e805c4d061e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.217621 Jan 19 13:05:09.462447 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 71/148] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:09 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:09.464923 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c22ad688-cd0d-411c-9452-55944df671d0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.218322 Jan 19 13:05:09.465480 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 78/149] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:09 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:09.897856 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-db9771a1-ebca-4b3e-969c-556d89a436b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:09.898462 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-db9771a1-ebca-4b3e-969c-556d89a436b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:09.904530 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-db9771a1-ebca-4b3e-969c-556d89a436b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:09.904982 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-db9771a1-ebca-4b3e-969c-556d89a436b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:09.905287 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5e70dcb8-983a-4b6a-a383-51b28317ece0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:09.905756 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-db9771a1-ebca-4b3e-969c-556d89a436b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:09.905897 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5e70dcb8-983a-4b6a-a383-51b28317ece0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:09.906194 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-db9771a1-ebca-4b3e-969c-556d89a436b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:09.912213 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e70dcb8-983a-4b6a-a383-51b28317ece0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:09.912665 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e70dcb8-983a-4b6a-a383-51b28317ece0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:09.913449 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e70dcb8-983a-4b6a-a383-51b28317ece0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:09.913916 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e70dcb8-983a-4b6a-a383-51b28317ece0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:10.096430 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-db9771a1-ebca-4b3e-969c-556d89a436b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:10.100250 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5e70dcb8-983a-4b6a-a383-51b28317ece0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:10.103765 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-db9771a1-ebca-4b3e-969c-556d89a436b5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.210238 Jan 19 13:05:10.104355 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 72/150] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:09 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:10.107956 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5e70dcb8-983a-4b6a-a383-51b28317ece0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:10.109481 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5e70dcb8-983a-4b6a-a383-51b28317ece0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:10.110557 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5e70dcb8-983a-4b6a-a383-51b28317ece0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.209089 Jan 19 13:05:10.111104 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 79/151] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:09 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:10.478411 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-049b1292-693c-41a3-9b3d-cd20cd131d0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:10.479014 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-049b1292-693c-41a3-9b3d-cd20cd131d0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:10.481461 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-51dee26d-c7c8-4d82-a9e9-1dffaec5e3d9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:10.482064 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-51dee26d-c7c8-4d82-a9e9-1dffaec5e3d9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:10.485137 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-049b1292-693c-41a3-9b3d-cd20cd131d0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:10.485579 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-049b1292-693c-41a3-9b3d-cd20cd131d0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:10.486349 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-049b1292-693c-41a3-9b3d-cd20cd131d0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:10.486779 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-049b1292-693c-41a3-9b3d-cd20cd131d0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:10.487766 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-51dee26d-c7c8-4d82-a9e9-1dffaec5e3d9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:10.488252 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-51dee26d-c7c8-4d82-a9e9-1dffaec5e3d9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:10.489522 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-51dee26d-c7c8-4d82-a9e9-1dffaec5e3d9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:10.489959 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-51dee26d-c7c8-4d82-a9e9-1dffaec5e3d9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:10.672823 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-049b1292-693c-41a3-9b3d-cd20cd131d0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:10.680172 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-51dee26d-c7c8-4d82-a9e9-1dffaec5e3d9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:10.680999 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-049b1292-693c-41a3-9b3d-cd20cd131d0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.206170 Jan 19 13:05:10.681662 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 73/152] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:10 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:10.687540 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-51dee26d-c7c8-4d82-a9e9-1dffaec5e3d9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.209656 Jan 19 13:05:10.688107 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 80/153] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:10 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:11.119722 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5c237aef-8a62-4559-b1de-2e1c5660b3ef tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:11.120376 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5c237aef-8a62-4559-b1de-2e1c5660b3ef tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:11.126507 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5c237aef-8a62-4559-b1de-2e1c5660b3ef tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:11.126960 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5c237aef-8a62-4559-b1de-2e1c5660b3ef tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:11.127735 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5c237aef-8a62-4559-b1de-2e1c5660b3ef tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:11.128208 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5c237aef-8a62-4559-b1de-2e1c5660b3ef tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:11.128680 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4bdd9128-8b75-4b2b-936d-8721fdcb136c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:11.129334 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4bdd9128-8b75-4b2b-936d-8721fdcb136c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:11.135638 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4bdd9128-8b75-4b2b-936d-8721fdcb136c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:11.136130 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4bdd9128-8b75-4b2b-936d-8721fdcb136c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:11.136887 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4bdd9128-8b75-4b2b-936d-8721fdcb136c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:11.137318 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4bdd9128-8b75-4b2b-936d-8721fdcb136c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:11.323362 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5c237aef-8a62-4559-b1de-2e1c5660b3ef tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:11.327560 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4bdd9128-8b75-4b2b-936d-8721fdcb136c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:11.330746 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5c237aef-8a62-4559-b1de-2e1c5660b3ef tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.214602 Jan 19 13:05:11.331374 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 74/154] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:11 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:11.335490 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4bdd9128-8b75-4b2b-936d-8721fdcb136c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:11.337018 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4bdd9128-8b75-4b2b-936d-8721fdcb136c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:11.338110 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4bdd9128-8b75-4b2b-936d-8721fdcb136c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.213171 Jan 19 13:05:11.338653 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 81/155] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:11 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:11.698159 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-dd1a37b4-a4d8-4f9e-8b3e-43966996e225 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:11.698809 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-dd1a37b4-a4d8-4f9e-8b3e-43966996e225 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:11.704064 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-738d0da7-3bc7-46c7-bd3c-36f2e440e5f4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:11.704635 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-738d0da7-3bc7-46c7-bd3c-36f2e440e5f4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:11.704738 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dd1a37b4-a4d8-4f9e-8b3e-43966996e225 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:11.705254 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dd1a37b4-a4d8-4f9e-8b3e-43966996e225 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:11.706034 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dd1a37b4-a4d8-4f9e-8b3e-43966996e225 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:11.706468 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dd1a37b4-a4d8-4f9e-8b3e-43966996e225 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:11.711027 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-738d0da7-3bc7-46c7-bd3c-36f2e440e5f4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:11.711729 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-738d0da7-3bc7-46c7-bd3c-36f2e440e5f4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:11.712541 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-738d0da7-3bc7-46c7-bd3c-36f2e440e5f4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:11.713165 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-738d0da7-3bc7-46c7-bd3c-36f2e440e5f4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:11.905600 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-dd1a37b4-a4d8-4f9e-8b3e-43966996e225 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:11.913150 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-dd1a37b4-a4d8-4f9e-8b3e-43966996e225 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.218711 Jan 19 13:05:11.913728 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 75/156] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:11 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:11.917044 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-738d0da7-3bc7-46c7-bd3c-36f2e440e5f4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:11.924222 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-738d0da7-3bc7-46c7-bd3c-36f2e440e5f4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.224154 Jan 19 13:05:11.924772 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 82/157] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:11 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:12.347053 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3132ca61-7155-4be9-adc5-b97731aab5b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:12.347659 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3132ca61-7155-4be9-adc5-b97731aab5b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:12.354580 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3132ca61-7155-4be9-adc5-b97731aab5b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:12.355027 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3132ca61-7155-4be9-adc5-b97731aab5b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:12.355819 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3132ca61-7155-4be9-adc5-b97731aab5b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:12.355922 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2ab1769a-0ffa-4924-bc2f-8344a5cde006 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:12.356289 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3132ca61-7155-4be9-adc5-b97731aab5b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:12.356545 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2ab1769a-0ffa-4924-bc2f-8344a5cde006 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:12.362262 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ab1769a-0ffa-4924-bc2f-8344a5cde006 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:12.362710 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ab1769a-0ffa-4924-bc2f-8344a5cde006 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:12.363484 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ab1769a-0ffa-4924-bc2f-8344a5cde006 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:12.364734 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ab1769a-0ffa-4924-bc2f-8344a5cde006 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:12.547172 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3132ca61-7155-4be9-adc5-b97731aab5b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:12.551232 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2ab1769a-0ffa-4924-bc2f-8344a5cde006 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:12.554994 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3132ca61-7155-4be9-adc5-b97731aab5b9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.211473 Jan 19 13:05:12.555862 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 76/158] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:12 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:12.560457 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2ab1769a-0ffa-4924-bc2f-8344a5cde006 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:12.561941 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2ab1769a-0ffa-4924-bc2f-8344a5cde006 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:12.563020 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2ab1769a-0ffa-4924-bc2f-8344a5cde006 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.210749 Jan 19 13:05:12.563566 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 83/159] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:12 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:12.929924 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f968871a-e52c-4edc-9284-eb4b7cf65329 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:12.930529 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f968871a-e52c-4edc-9284-eb4b7cf65329 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:12.936816 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f968871a-e52c-4edc-9284-eb4b7cf65329 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:12.937292 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f968871a-e52c-4edc-9284-eb4b7cf65329 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:12.938080 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f968871a-e52c-4edc-9284-eb4b7cf65329 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:12.938520 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f968871a-e52c-4edc-9284-eb4b7cf65329 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:12.941464 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d0c3a94b-9581-4bf7-bb42-e7349ff5f0f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:12.942564 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d0c3a94b-9581-4bf7-bb42-e7349ff5f0f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:12.948646 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d0c3a94b-9581-4bf7-bb42-e7349ff5f0f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:12.949097 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d0c3a94b-9581-4bf7-bb42-e7349ff5f0f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:12.949944 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d0c3a94b-9581-4bf7-bb42-e7349ff5f0f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:12.950376 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d0c3a94b-9581-4bf7-bb42-e7349ff5f0f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:13.135898 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f968871a-e52c-4edc-9284-eb4b7cf65329 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:13.144744 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f968871a-e52c-4edc-9284-eb4b7cf65329 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.218536 Jan 19 13:05:13.146234 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 77/160] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:12 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:13.149245 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d0c3a94b-9581-4bf7-bb42-e7349ff5f0f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:13.156979 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d0c3a94b-9581-4bf7-bb42-e7349ff5f0f9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.219303 Jan 19 13:05:13.157576 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 84/161] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:12 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:13.474462 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-301fec81-5e19-42a3-97bc-ccf6e5561cbc req-e53a238e-ebab-479c-95d9-d031805477fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa85ce7-f190-47c1-bf94-e1d5d7b98070", "name": "network-vif-plugged", "status": "completed", "tag": "c2682348-227e-4a90-8c47-f6e3e523ed6d"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:13.476090 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:05:13.476090 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:05:13.483053 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-301fec81-5e19-42a3-97bc-ccf6e5561cbc req-e53a238e-ebab-479c-95d9-d031805477fe service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:13.483251 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-301fec81-5e19-42a3-97bc-ccf6e5561cbc req-e53a238e-ebab-479c-95d9-d031805477fe service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:13.495863 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-301fec81-5e19-42a3-97bc-ccf6e5561cbc req-e53a238e-ebab-479c-95d9-d031805477fe service nova] Creating event network-vif-plugged:c2682348-227e-4a90-8c47-f6e3e523ed6d for instance 3fa85ce7-f190-47c1-bf94-e1d5d7b98070 on hv-cinder-82301 Jan 19 13:05:13.501010 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-301fec81-5e19-42a3-97bc-ccf6e5561cbc req-e53a238e-ebab-479c-95d9-d031805477fe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088889 Jan 19 13:05:13.501852 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 78/162] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:05:13.571366 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-69a7a0fb-4bcf-4f24-ab53-0f2edbbd4d55 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:13.572078 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-69a7a0fb-4bcf-4f24-ab53-0f2edbbd4d55 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:13.578182 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-69a7a0fb-4bcf-4f24-ab53-0f2edbbd4d55 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:13.578718 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-69a7a0fb-4bcf-4f24-ab53-0f2edbbd4d55 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:13.579723 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-69a7a0fb-4bcf-4f24-ab53-0f2edbbd4d55 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:13.580264 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-69a7a0fb-4bcf-4f24-ab53-0f2edbbd4d55 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:13.584001 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b79827a5-8a5d-468b-a2ab-291129876cf5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:13.584919 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b79827a5-8a5d-468b-a2ab-291129876cf5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:13.591864 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b79827a5-8a5d-468b-a2ab-291129876cf5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:13.592542 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b79827a5-8a5d-468b-a2ab-291129876cf5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:13.593508 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b79827a5-8a5d-468b-a2ab-291129876cf5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:13.594281 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b79827a5-8a5d-468b-a2ab-291129876cf5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:13.837688 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-69a7a0fb-4bcf-4f24-ab53-0f2edbbd4d55 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:13.842253 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b79827a5-8a5d-468b-a2ab-291129876cf5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:13.844995 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-69a7a0fb-4bcf-4f24-ab53-0f2edbbd4d55 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.277507 Jan 19 13:05:13.851225 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b79827a5-8a5d-468b-a2ab-291129876cf5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:13.852851 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b79827a5-8a5d-468b-a2ab-291129876cf5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:13.854140 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b79827a5-8a5d-468b-a2ab-291129876cf5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.276576 Jan 19 13:05:13.854640 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 85/163] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:13 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:13.854826 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 79/164] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:13 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:05:14.162658 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b2a62eaa-a45a-4c4d-aab9-ac676dab5d64 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:14.163343 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b2a62eaa-a45a-4c4d-aab9-ac676dab5d64 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:14.169313 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b2a62eaa-a45a-4c4d-aab9-ac676dab5d64 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:14.169866 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b2a62eaa-a45a-4c4d-aab9-ac676dab5d64 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:14.170729 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b2a62eaa-a45a-4c4d-aab9-ac676dab5d64 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:14.171238 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b2a62eaa-a45a-4c4d-aab9-ac676dab5d64 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:14.173521 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ffa85b1a-9941-42ae-a1a2-82fa8c8b0e6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:14.174274 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ffa85b1a-9941-42ae-a1a2-82fa8c8b0e6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:14.180208 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ffa85b1a-9941-42ae-a1a2-82fa8c8b0e6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:14.180656 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ffa85b1a-9941-42ae-a1a2-82fa8c8b0e6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:14.181424 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ffa85b1a-9941-42ae-a1a2-82fa8c8b0e6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:14.181859 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ffa85b1a-9941-42ae-a1a2-82fa8c8b0e6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:14.377971 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b2a62eaa-a45a-4c4d-aab9-ac676dab5d64 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:14.382897 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ffa85b1a-9941-42ae-a1a2-82fa8c8b0e6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:14.386355 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b2a62eaa-a45a-4c4d-aab9-ac676dab5d64 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.228279 Jan 19 13:05:14.387027 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 86/165] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:14 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:14.393596 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ffa85b1a-9941-42ae-a1a2-82fa8c8b0e6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.224452 Jan 19 13:05:14.394162 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 80/166] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:14 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:14.861713 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d6fe409b-6d5c-46c8-b731-3e927c9bba02 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:14.862318 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d6fe409b-6d5c-46c8-b731-3e927c9bba02 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:14.869166 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d6fe409b-6d5c-46c8-b731-3e927c9bba02 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:14.869611 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d6fe409b-6d5c-46c8-b731-3e927c9bba02 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:14.870410 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d6fe409b-6d5c-46c8-b731-3e927c9bba02 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:14.870840 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d6fe409b-6d5c-46c8-b731-3e927c9bba02 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:14.872377 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-763eefe8-7fee-46b2-9dc7-abf2162a9060 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:14.872988 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-763eefe8-7fee-46b2-9dc7-abf2162a9060 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:14.879908 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-763eefe8-7fee-46b2-9dc7-abf2162a9060 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:14.880419 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-763eefe8-7fee-46b2-9dc7-abf2162a9060 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:14.881206 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-763eefe8-7fee-46b2-9dc7-abf2162a9060 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:14.881646 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-763eefe8-7fee-46b2-9dc7-abf2162a9060 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:15.064628 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d6fe409b-6d5c-46c8-b731-3e927c9bba02 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:15.068526 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-763eefe8-7fee-46b2-9dc7-abf2162a9060 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:15.071970 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d6fe409b-6d5c-46c8-b731-3e927c9bba02 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.213883 Jan 19 13:05:15.072566 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 87/167] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:14 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:15.077129 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-763eefe8-7fee-46b2-9dc7-abf2162a9060 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:15.078727 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-763eefe8-7fee-46b2-9dc7-abf2162a9060 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:15.079913 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-763eefe8-7fee-46b2-9dc7-abf2162a9060 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.211132 Jan 19 13:05:15.080563 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 81/168] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:14 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:15.403295 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-093e0d46-82f4-4439-a88b-88f566a82580 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:15.403897 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-093e0d46-82f4-4439-a88b-88f566a82580 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:15.409850 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-093e0d46-82f4-4439-a88b-88f566a82580 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:15.410052 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-fb17c4da-8ba3-4446-8219-ba3f68eece51 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:15.411087 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-093e0d46-82f4-4439-a88b-88f566a82580 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:15.411693 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-093e0d46-82f4-4439-a88b-88f566a82580 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:15.412152 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-093e0d46-82f4-4439-a88b-88f566a82580 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:15.412562 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-fb17c4da-8ba3-4446-8219-ba3f68eece51 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:15.419027 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fb17c4da-8ba3-4446-8219-ba3f68eece51 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:15.419027 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fb17c4da-8ba3-4446-8219-ba3f68eece51 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:15.419891 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fb17c4da-8ba3-4446-8219-ba3f68eece51 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:15.420376 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fb17c4da-8ba3-4446-8219-ba3f68eece51 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:15.602703 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-093e0d46-82f4-4439-a88b-88f566a82580 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:15.610117 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-fb17c4da-8ba3-4446-8219-ba3f68eece51 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:15.610265 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-093e0d46-82f4-4439-a88b-88f566a82580 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.210463 Jan 19 13:05:15.610774 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 88/169] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:15 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:15.617470 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-fb17c4da-8ba3-4446-8219-ba3f68eece51 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.210944 Jan 19 13:05:15.618178 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 82/170] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:15 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:16.089378 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e23767eb-695d-46f8-923c-82cdbcb4f208 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:16.089978 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e23767eb-695d-46f8-923c-82cdbcb4f208 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:16.095854 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e23767eb-695d-46f8-923c-82cdbcb4f208 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:16.096326 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e23767eb-695d-46f8-923c-82cdbcb4f208 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:16.097085 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e23767eb-695d-46f8-923c-82cdbcb4f208 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:16.097304 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4cdc7d12-bab2-40e1-85bb-733007878da4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:16.097514 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e23767eb-695d-46f8-923c-82cdbcb4f208 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:16.098237 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4cdc7d12-bab2-40e1-85bb-733007878da4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:16.104829 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4cdc7d12-bab2-40e1-85bb-733007878da4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:16.105272 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4cdc7d12-bab2-40e1-85bb-733007878da4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:16.106036 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4cdc7d12-bab2-40e1-85bb-733007878da4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:16.106464 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4cdc7d12-bab2-40e1-85bb-733007878da4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:16.284723 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-e23767eb-695d-46f8-923c-82cdbcb4f208 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:16.288772 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4cdc7d12-bab2-40e1-85bb-733007878da4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:16.292985 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e23767eb-695d-46f8-923c-82cdbcb4f208 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.207180 Jan 19 13:05:16.293566 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 89/171] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:16 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:16.297031 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4cdc7d12-bab2-40e1-85bb-733007878da4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:16.298607 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4cdc7d12-bab2-40e1-85bb-733007878da4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:16.299696 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4cdc7d12-bab2-40e1-85bb-733007878da4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.206029 Jan 19 13:05:16.300416 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 83/172] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:16 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:16.627017 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-de2baa1c-4d3d-4a62-96c5-415949209170 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:16.627650 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-de2baa1c-4d3d-4a62-96c5-415949209170 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:16.633590 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-bf60da69-0ba9-458e-a06d-5dd3713d26d3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:16.634021 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-de2baa1c-4d3d-4a62-96c5-415949209170 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:16.634021 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-de2baa1c-4d3d-4a62-96c5-415949209170 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:16.634602 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-bf60da69-0ba9-458e-a06d-5dd3713d26d3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:16.634802 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-de2baa1c-4d3d-4a62-96c5-415949209170 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:16.635241 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-de2baa1c-4d3d-4a62-96c5-415949209170 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:16.640693 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bf60da69-0ba9-458e-a06d-5dd3713d26d3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:16.641137 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bf60da69-0ba9-458e-a06d-5dd3713d26d3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:16.641901 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bf60da69-0ba9-458e-a06d-5dd3713d26d3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:16.642326 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bf60da69-0ba9-458e-a06d-5dd3713d26d3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:16.830889 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-de2baa1c-4d3d-4a62-96c5-415949209170 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:16.834715 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-bf60da69-0ba9-458e-a06d-5dd3713d26d3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:16.839161 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-de2baa1c-4d3d-4a62-96c5-415949209170 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.215760 Jan 19 13:05:16.840239 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 90/173] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:16 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:16.841857 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-bf60da69-0ba9-458e-a06d-5dd3713d26d3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.211972 Jan 19 13:05:16.842402 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 84/174] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:16 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:17.309792 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ee4d2309-c57f-4d51-b823-e4706bd896ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:17.310400 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ee4d2309-c57f-4d51-b823-e4706bd896ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:17.316253 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ee4d2309-c57f-4d51-b823-e4706bd896ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:17.316701 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ee4d2309-c57f-4d51-b823-e4706bd896ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:17.317480 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ee4d2309-c57f-4d51-b823-e4706bd896ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:17.317746 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-eb61c3cd-fe7d-458e-91ab-b3170834093e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:17.317956 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ee4d2309-c57f-4d51-b823-e4706bd896ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:17.318384 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-eb61c3cd-fe7d-458e-91ab-b3170834093e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:17.324414 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb61c3cd-fe7d-458e-91ab-b3170834093e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:17.324863 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb61c3cd-fe7d-458e-91ab-b3170834093e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:17.325635 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb61c3cd-fe7d-458e-91ab-b3170834093e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:17.326064 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb61c3cd-fe7d-458e-91ab-b3170834093e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:17.509116 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ee4d2309-c57f-4d51-b823-e4706bd896ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:17.512976 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-eb61c3cd-fe7d-458e-91ab-b3170834093e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:17.516666 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ee4d2309-c57f-4d51-b823-e4706bd896ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.210425 Jan 19 13:05:17.517235 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 91/175] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:17 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:17.520782 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-eb61c3cd-fe7d-458e-91ab-b3170834093e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:17.522294 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-eb61c3cd-fe7d-458e-91ab-b3170834093e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:17.523380 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-eb61c3cd-fe7d-458e-91ab-b3170834093e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.209306 Jan 19 13:05:17.523916 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 85/176] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:17 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:17.855763 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-40141d0a-2e1e-469a-be43-9cc6cbaeed8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:17.856419 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-40141d0a-2e1e-469a-be43-9cc6cbaeed8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:17.857695 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-247d5321-18f5-42f7-9d7a-682c5b06ed61 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:17.858295 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-247d5321-18f5-42f7-9d7a-682c5b06ed61 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:17.862488 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-40141d0a-2e1e-469a-be43-9cc6cbaeed8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:17.862934 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-40141d0a-2e1e-469a-be43-9cc6cbaeed8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:17.863710 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-40141d0a-2e1e-469a-be43-9cc6cbaeed8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:17.864175 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-40141d0a-2e1e-469a-be43-9cc6cbaeed8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:17.865271 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-247d5321-18f5-42f7-9d7a-682c5b06ed61 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:17.865551 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-247d5321-18f5-42f7-9d7a-682c5b06ed61 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:17.866306 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-247d5321-18f5-42f7-9d7a-682c5b06ed61 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:17.867098 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-247d5321-18f5-42f7-9d7a-682c5b06ed61 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:18.226607 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-247d5321-18f5-42f7-9d7a-682c5b06ed61 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:18.228807 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-40141d0a-2e1e-469a-be43-9cc6cbaeed8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:18.234260 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-247d5321-18f5-42f7-9d7a-682c5b06ed61 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.380020 Jan 19 13:05:18.234913 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 86/177] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:17 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:18.245336 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-40141d0a-2e1e-469a-be43-9cc6cbaeed8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.393155 Jan 19 13:05:18.246115 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 92/178] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:17 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:18.533527 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-cd76dd9e-74ad-45a7-b117-0b41063cb704 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:18.534068 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-cd76dd9e-74ad-45a7-b117-0b41063cb704 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:18.540134 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cd76dd9e-74ad-45a7-b117-0b41063cb704 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:18.540439 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d14ae168-52d2-4e32-9cd2-e55910eec25f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:18.540581 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cd76dd9e-74ad-45a7-b117-0b41063cb704 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:18.541045 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d14ae168-52d2-4e32-9cd2-e55910eec25f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:18.541340 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cd76dd9e-74ad-45a7-b117-0b41063cb704 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:18.541769 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cd76dd9e-74ad-45a7-b117-0b41063cb704 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:18.546771 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d14ae168-52d2-4e32-9cd2-e55910eec25f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:18.547220 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d14ae168-52d2-4e32-9cd2-e55910eec25f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:18.548005 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d14ae168-52d2-4e32-9cd2-e55910eec25f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:18.548453 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d14ae168-52d2-4e32-9cd2-e55910eec25f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:18.728698 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-cd76dd9e-74ad-45a7-b117-0b41063cb704 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:18.735494 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d14ae168-52d2-4e32-9cd2-e55910eec25f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:18.736056 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-cd76dd9e-74ad-45a7-b117-0b41063cb704 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.206209 Jan 19 13:05:18.736634 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 87/179] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:18 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:18.744824 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d14ae168-52d2-4e32-9cd2-e55910eec25f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:18.746324 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d14ae168-52d2-4e32-9cd2-e55910eec25f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:18.747416 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d14ae168-52d2-4e32-9cd2-e55910eec25f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.210958 Jan 19 13:05:18.747960 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 93/180] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:18 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:19.251616 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-28c5b712-c5ae-4a57-b922-4373379f8c4f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:19.252239 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-28c5b712-c5ae-4a57-b922-4373379f8c4f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:19.258300 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-28c5b712-c5ae-4a57-b922-4373379f8c4f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:19.258749 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-28c5b712-c5ae-4a57-b922-4373379f8c4f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:19.259520 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-28c5b712-c5ae-4a57-b922-4373379f8c4f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:19.259957 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-28c5b712-c5ae-4a57-b922-4373379f8c4f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:19.261873 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7b527315-938c-4d3f-b1cf-f58585c1823e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:19.262465 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7b527315-938c-4d3f-b1cf-f58585c1823e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:19.268458 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7b527315-938c-4d3f-b1cf-f58585c1823e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:19.269188 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7b527315-938c-4d3f-b1cf-f58585c1823e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:19.269957 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7b527315-938c-4d3f-b1cf-f58585c1823e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:19.270385 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7b527315-938c-4d3f-b1cf-f58585c1823e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:19.453618 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-28c5b712-c5ae-4a57-b922-4373379f8c4f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:19.456732 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7b527315-938c-4d3f-b1cf-f58585c1823e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:19.461882 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-28c5b712-c5ae-4a57-b922-4373379f8c4f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.213898 Jan 19 13:05:19.462460 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 88/181] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:19 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:19.465124 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7b527315-938c-4d3f-b1cf-f58585c1823e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.206786 Jan 19 13:05:19.465747 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 94/182] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:19 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:19.753202 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d5c6c3d0-5087-4e7c-85f8-5a4e20d3771c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:19.753732 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d5c6c3d0-5087-4e7c-85f8-5a4e20d3771c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:19.759919 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d5c6c3d0-5087-4e7c-85f8-5a4e20d3771c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:19.760407 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d5c6c3d0-5087-4e7c-85f8-5a4e20d3771c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:19.761262 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d5c6c3d0-5087-4e7c-85f8-5a4e20d3771c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:19.761695 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d5c6c3d0-5087-4e7c-85f8-5a4e20d3771c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:19.765679 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-993290b4-1566-41ee-9ca1-f99f7be36d50 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:19.766278 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-993290b4-1566-41ee-9ca1-f99f7be36d50 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:19.772025 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-993290b4-1566-41ee-9ca1-f99f7be36d50 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:19.772482 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-993290b4-1566-41ee-9ca1-f99f7be36d50 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:19.773260 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-993290b4-1566-41ee-9ca1-f99f7be36d50 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:19.773703 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-993290b4-1566-41ee-9ca1-f99f7be36d50 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:19.961600 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d5c6c3d0-5087-4e7c-85f8-5a4e20d3771c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:19.968732 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-993290b4-1566-41ee-9ca1-f99f7be36d50 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:19.969215 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d5c6c3d0-5087-4e7c-85f8-5a4e20d3771c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.219748 Jan 19 13:05:19.970053 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 89/183] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:19 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:19.983334 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-993290b4-1566-41ee-9ca1-f99f7be36d50 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:19.983334 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-993290b4-1566-41ee-9ca1-f99f7be36d50 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:19.983334 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-993290b4-1566-41ee-9ca1-f99f7be36d50 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.219011 Jan 19 13:05:19.983602 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 95/184] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:19 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:20.477733 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-14269dbc-e5ab-4f0b-a3c7-72d768293c71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:20.478339 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-14269dbc-e5ab-4f0b-a3c7-72d768293c71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:20.482650 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b31f2c01-874b-400b-9734-28a546986035 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:20.483250 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b31f2c01-874b-400b-9734-28a546986035 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:20.484339 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-14269dbc-e5ab-4f0b-a3c7-72d768293c71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:20.484845 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-14269dbc-e5ab-4f0b-a3c7-72d768293c71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:20.485592 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-14269dbc-e5ab-4f0b-a3c7-72d768293c71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:20.486027 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-14269dbc-e5ab-4f0b-a3c7-72d768293c71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:20.489035 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b31f2c01-874b-400b-9734-28a546986035 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:20.489490 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b31f2c01-874b-400b-9734-28a546986035 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:20.490879 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b31f2c01-874b-400b-9734-28a546986035 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:20.491324 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b31f2c01-874b-400b-9734-28a546986035 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:20.680179 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-14269dbc-e5ab-4f0b-a3c7-72d768293c71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:20.684163 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b31f2c01-874b-400b-9734-28a546986035 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:20.688348 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-14269dbc-e5ab-4f0b-a3c7-72d768293c71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.214249 Jan 19 13:05:20.688920 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 90/185] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:20 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:20.691519 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b31f2c01-874b-400b-9734-28a546986035 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.212418 Jan 19 13:05:20.692228 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 96/186] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:20 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:20.986421 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-33c52e40-e330-4063-a318-0d18426eb7c5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:20.987024 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-33c52e40-e330-4063-a318-0d18426eb7c5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:20.993311 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33c52e40-e330-4063-a318-0d18426eb7c5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:20.993855 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33c52e40-e330-4063-a318-0d18426eb7c5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:20.994637 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33c52e40-e330-4063-a318-0d18426eb7c5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:20.995066 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33c52e40-e330-4063-a318-0d18426eb7c5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:20.999925 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ec11149f-3b22-43a4-b9e3-f84cbfc157cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:20.999925 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ec11149f-3b22-43a4-b9e3-f84cbfc157cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:21.007091 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ec11149f-3b22-43a4-b9e3-f84cbfc157cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:21.007266 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ec11149f-3b22-43a4-b9e3-f84cbfc157cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:21.008131 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ec11149f-3b22-43a4-b9e3-f84cbfc157cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:21.008571 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ec11149f-3b22-43a4-b9e3-f84cbfc157cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:21.181558 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-33c52e40-e330-4063-a318-0d18426eb7c5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:21.188752 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-33c52e40-e330-4063-a318-0d18426eb7c5 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.205918 Jan 19 13:05:21.189313 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 91/187] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:20 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:21.202415 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ec11149f-3b22-43a4-b9e3-f84cbfc157cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:21.211048 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ec11149f-3b22-43a4-b9e3-f84cbfc157cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:21.212562 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ec11149f-3b22-43a4-b9e3-f84cbfc157cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:21.213646 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ec11149f-3b22-43a4-b9e3-f84cbfc157cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.218720 Jan 19 13:05:21.214189 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 97/188] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:20 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:21.705233 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-69d39625-a68b-4aa4-9132-23f39334ad3c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:21.705842 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-69d39625-a68b-4aa4-9132-23f39334ad3c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:21.707354 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-46b7d18d-eb54-487f-a7ab-0bd0ffe7494a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:21.707956 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-46b7d18d-eb54-487f-a7ab-0bd0ffe7494a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:21.712491 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-69d39625-a68b-4aa4-9132-23f39334ad3c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:21.712942 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-69d39625-a68b-4aa4-9132-23f39334ad3c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:21.713721 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-69d39625-a68b-4aa4-9132-23f39334ad3c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:21.714172 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-69d39625-a68b-4aa4-9132-23f39334ad3c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:21.714349 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-46b7d18d-eb54-487f-a7ab-0bd0ffe7494a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:21.714783 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-46b7d18d-eb54-487f-a7ab-0bd0ffe7494a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:21.715552 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-46b7d18d-eb54-487f-a7ab-0bd0ffe7494a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:21.716063 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-46b7d18d-eb54-487f-a7ab-0bd0ffe7494a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:21.908875 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-69d39625-a68b-4aa4-9132-23f39334ad3c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:21.912605 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-46b7d18d-eb54-487f-a7ab-0bd0ffe7494a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:21.917346 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-69d39625-a68b-4aa4-9132-23f39334ad3c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.215755 Jan 19 13:05:21.917917 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 92/189] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:21 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:21.919951 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-46b7d18d-eb54-487f-a7ab-0bd0ffe7494a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.216142 Jan 19 13:05:21.920539 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 98/190] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:21 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:22.205589 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c2770351-556a-4b98-8ceb-95395821eb26 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:22.206218 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c2770351-556a-4b98-8ceb-95395821eb26 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:22.212188 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c2770351-556a-4b98-8ceb-95395821eb26 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:22.212631 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c2770351-556a-4b98-8ceb-95395821eb26 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:22.213392 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c2770351-556a-4b98-8ceb-95395821eb26 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:22.213822 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c2770351-556a-4b98-8ceb-95395821eb26 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:22.232373 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-fc423f94-03ca-42da-880e-95c8f5797b3c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:22.233095 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-fc423f94-03ca-42da-880e-95c8f5797b3c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:22.238927 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fc423f94-03ca-42da-880e-95c8f5797b3c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:22.240318 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fc423f94-03ca-42da-880e-95c8f5797b3c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:22.241273 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fc423f94-03ca-42da-880e-95c8f5797b3c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:22.241715 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fc423f94-03ca-42da-880e-95c8f5797b3c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:22.402694 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-c2770351-556a-4b98-8ceb-95395821eb26 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:22.410000 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c2770351-556a-4b98-8ceb-95395821eb26 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.207990 Jan 19 13:05:22.410505 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 93/191] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:22 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:22.416475 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-fc423f94-03ca-42da-880e-95c8f5797b3c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:22.424370 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-fc423f94-03ca-42da-880e-95c8f5797b3c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:22.425905 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-fc423f94-03ca-42da-880e-95c8f5797b3c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:22.427605 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-fc423f94-03ca-42da-880e-95c8f5797b3c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.198299 Jan 19 13:05:22.428392 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 99/192] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:22 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:22.939123 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-90d26216-20ee-47ac-88b8-71a11c4137a2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:22.940159 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-90d26216-20ee-47ac-88b8-71a11c4137a2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:22.942214 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-005341a4-2d7b-4187-b390-a9c367b4cb6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:22.943692 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-005341a4-2d7b-4187-b390-a9c367b4cb6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:22.949571 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-90d26216-20ee-47ac-88b8-71a11c4137a2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:22.950308 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-90d26216-20ee-47ac-88b8-71a11c4137a2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:22.951607 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-90d26216-20ee-47ac-88b8-71a11c4137a2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:22.952355 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-90d26216-20ee-47ac-88b8-71a11c4137a2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:22.953039 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-005341a4-2d7b-4187-b390-a9c367b4cb6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:22.953766 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-005341a4-2d7b-4187-b390-a9c367b4cb6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:22.955072 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-005341a4-2d7b-4187-b390-a9c367b4cb6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:22.955795 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-005341a4-2d7b-4187-b390-a9c367b4cb6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:23.146665 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-90d26216-20ee-47ac-88b8-71a11c4137a2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:23.153751 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-005341a4-2d7b-4187-b390-a9c367b4cb6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:23.153891 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-90d26216-20ee-47ac-88b8-71a11c4137a2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.221076 Jan 19 13:05:23.154457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 94/193] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:22 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:23.161850 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-005341a4-2d7b-4187-b390-a9c367b4cb6f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.225216 Jan 19 13:05:23.162935 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 100/194] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:22 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:23.426482 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2f21ec00-ad77-4795-ab66-6b9f629409ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:23.427265 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2f21ec00-ad77-4795-ab66-6b9f629409ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:23.433031 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2f21ec00-ad77-4795-ab66-6b9f629409ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:23.433477 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2f21ec00-ad77-4795-ab66-6b9f629409ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:23.434244 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2f21ec00-ad77-4795-ab66-6b9f629409ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:23.434680 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2f21ec00-ad77-4795-ab66-6b9f629409ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:23.446006 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-08fefccb-7c37-4eff-808b-f3bf4849ae45 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:23.446603 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-08fefccb-7c37-4eff-808b-f3bf4849ae45 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:23.452446 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-08fefccb-7c37-4eff-808b-f3bf4849ae45 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:23.452892 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-08fefccb-7c37-4eff-808b-f3bf4849ae45 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:23.453667 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-08fefccb-7c37-4eff-808b-f3bf4849ae45 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:23.454102 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-08fefccb-7c37-4eff-808b-f3bf4849ae45 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:23.625896 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2f21ec00-ad77-4795-ab66-6b9f629409ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:23.633880 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-08fefccb-7c37-4eff-808b-f3bf4849ae45 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:23.634373 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2f21ec00-ad77-4795-ab66-6b9f629409ea tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.211554 Jan 19 13:05:23.634945 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 95/195] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:23 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:23.642035 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-08fefccb-7c37-4eff-808b-f3bf4849ae45 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:23.643536 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-08fefccb-7c37-4eff-808b-f3bf4849ae45 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:23.644650 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-08fefccb-7c37-4eff-808b-f3bf4849ae45 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.202876 Jan 19 13:05:23.645197 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 101/196] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:23 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:24.170367 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-79ee451c-a085-48c6-88da-fc3ef31bf4b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:24.170968 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-79ee451c-a085-48c6-88da-fc3ef31bf4b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:24.177559 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-79ee451c-a085-48c6-88da-fc3ef31bf4b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:24.178060 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-79ee451c-a085-48c6-88da-fc3ef31bf4b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:24.178837 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-79ee451c-a085-48c6-88da-fc3ef31bf4b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:24.178951 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-aea96f48-0128-4674-a0f1-d8dbf7e39925 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:24.179344 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-79ee451c-a085-48c6-88da-fc3ef31bf4b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:24.179499 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-aea96f48-0128-4674-a0f1-d8dbf7e39925 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:24.185307 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aea96f48-0128-4674-a0f1-d8dbf7e39925 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:24.185756 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aea96f48-0128-4674-a0f1-d8dbf7e39925 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:24.186538 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aea96f48-0128-4674-a0f1-d8dbf7e39925 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:24.186972 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aea96f48-0128-4674-a0f1-d8dbf7e39925 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:24.375008 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-79ee451c-a085-48c6-88da-fc3ef31bf4b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:24.378201 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-aea96f48-0128-4674-a0f1-d8dbf7e39925 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:24.382770 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-79ee451c-a085-48c6-88da-fc3ef31bf4b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.216033 Jan 19 13:05:24.383343 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 96/197] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:24 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:24.385535 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-aea96f48-0128-4674-a0f1-d8dbf7e39925 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.210817 Jan 19 13:05:24.386091 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 102/198] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:24 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:24.654267 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b13c01d2-19ea-48c1-b1a5-2913b2e008a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:24.655036 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b13c01d2-19ea-48c1-b1a5-2913b2e008a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:24.662330 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b13c01d2-19ea-48c1-b1a5-2913b2e008a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:24.662723 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-65fe2157-806a-48b5-9294-fe7ab4a49948 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:24.663317 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b13c01d2-19ea-48c1-b1a5-2913b2e008a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:24.663425 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-65fe2157-806a-48b5-9294-fe7ab4a49948 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:24.664813 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b13c01d2-19ea-48c1-b1a5-2913b2e008a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:24.665457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b13c01d2-19ea-48c1-b1a5-2913b2e008a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:24.669663 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-65fe2157-806a-48b5-9294-fe7ab4a49948 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:24.670120 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-65fe2157-806a-48b5-9294-fe7ab4a49948 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:24.670911 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-65fe2157-806a-48b5-9294-fe7ab4a49948 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:24.671353 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-65fe2157-806a-48b5-9294-fe7ab4a49948 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:24.870156 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b13c01d2-19ea-48c1-b1a5-2913b2e008a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:24.877724 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b13c01d2-19ea-48c1-b1a5-2913b2e008a0 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.230216 Jan 19 13:05:24.877892 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-65fe2157-806a-48b5-9294-fe7ab4a49948 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:24.878300 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 97/199] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:24 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:24.892138 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-65fe2157-806a-48b5-9294-fe7ab4a49948 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:24.893632 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-65fe2157-806a-48b5-9294-fe7ab4a49948 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:24.894715 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-65fe2157-806a-48b5-9294-fe7ab4a49948 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.236709 Jan 19 13:05:24.895441 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 103/200] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:24 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:05:25.399512 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ccc79aba-4f3c-4621-ac0b-04ebb4e890cb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:25.400150 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ccc79aba-4f3c-4621-ac0b-04ebb4e890cb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:25.401676 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-672011af-c293-4256-a0ef-683943b14916 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:25.402275 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-672011af-c293-4256-a0ef-683943b14916 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:25.406170 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ccc79aba-4f3c-4621-ac0b-04ebb4e890cb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:25.406622 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ccc79aba-4f3c-4621-ac0b-04ebb4e890cb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:25.407393 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ccc79aba-4f3c-4621-ac0b-04ebb4e890cb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:25.407833 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ccc79aba-4f3c-4621-ac0b-04ebb4e890cb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:25.408002 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-672011af-c293-4256-a0ef-683943b14916 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:25.408464 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-672011af-c293-4256-a0ef-683943b14916 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:25.409238 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-672011af-c293-4256-a0ef-683943b14916 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:25.409691 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-672011af-c293-4256-a0ef-683943b14916 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:25.595502 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-672011af-c293-4256-a0ef-683943b14916 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:25.599104 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ccc79aba-4f3c-4621-ac0b-04ebb4e890cb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:25.603433 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-672011af-c293-4256-a0ef-683943b14916 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.205286 Jan 19 13:05:25.604025 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 104/201] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:25 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:25.606329 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ccc79aba-4f3c-4621-ac0b-04ebb4e890cb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.210514 Jan 19 13:05:25.606878 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 98/202] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:25 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:25.894360 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-755f445a-35bd-415c-94a7-ee686851006c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:25.894958 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-755f445a-35bd-415c-94a7-ee686851006c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:25.901898 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-755f445a-35bd-415c-94a7-ee686851006c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:25.902346 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-755f445a-35bd-415c-94a7-ee686851006c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:25.903139 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-755f445a-35bd-415c-94a7-ee686851006c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:25.903585 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-755f445a-35bd-415c-94a7-ee686851006c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:25.913531 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6f91b051-98eb-4d20-a452-866ec8d4c541 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:25.914067 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6f91b051-98eb-4d20-a452-866ec8d4c541 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:25.919879 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f91b051-98eb-4d20-a452-866ec8d4c541 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:25.920364 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f91b051-98eb-4d20-a452-866ec8d4c541 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:25.921136 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f91b051-98eb-4d20-a452-866ec8d4c541 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:25.921568 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f91b051-98eb-4d20-a452-866ec8d4c541 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:26.097918 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-755f445a-35bd-415c-94a7-ee686851006c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:26.105898 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-755f445a-35bd-415c-94a7-ee686851006c tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.215130 Jan 19 13:05:26.106466 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 105/203] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:25 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:26.109762 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6f91b051-98eb-4d20-a452-866ec8d4c541 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:26.117475 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6f91b051-98eb-4d20-a452-866ec8d4c541 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:26.118992 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6f91b051-98eb-4d20-a452-866ec8d4c541 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:26.120098 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6f91b051-98eb-4d20-a452-866ec8d4c541 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.211087 Jan 19 13:05:26.120641 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 99/204] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:25 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:26.620551 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-39c96a1b-e2ff-4d82-8f14-5a7ae8e234fa tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:26.621151 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-39c96a1b-e2ff-4d82-8f14-5a7ae8e234fa tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:26.622899 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-01d6a5f0-7d36-4d4f-81fd-655e1dd15a2f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:26.623505 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-01d6a5f0-7d36-4d4f-81fd-655e1dd15a2f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:26.627022 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-39c96a1b-e2ff-4d82-8f14-5a7ae8e234fa tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:26.627459 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-39c96a1b-e2ff-4d82-8f14-5a7ae8e234fa tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:26.628251 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-39c96a1b-e2ff-4d82-8f14-5a7ae8e234fa tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:26.628678 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-39c96a1b-e2ff-4d82-8f14-5a7ae8e234fa tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:26.629375 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-01d6a5f0-7d36-4d4f-81fd-655e1dd15a2f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:26.629880 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-01d6a5f0-7d36-4d4f-81fd-655e1dd15a2f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:26.630846 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-01d6a5f0-7d36-4d4f-81fd-655e1dd15a2f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:26.631308 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-01d6a5f0-7d36-4d4f-81fd-655e1dd15a2f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:26.815125 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-01d6a5f0-7d36-4d4f-81fd-655e1dd15a2f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:26.822160 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-39c96a1b-e2ff-4d82-8f14-5a7ae8e234fa tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:26.822546 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-01d6a5f0-7d36-4d4f-81fd-655e1dd15a2f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.203214 Jan 19 13:05:26.823117 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 100/205] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:26 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:26.829406 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-39c96a1b-e2ff-4d82-8f14-5a7ae8e234fa tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.212525 Jan 19 13:05:26.829951 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 106/206] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:26 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:27.122185 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d04f2591-f290-420f-9f71-24b9f265e11b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:27.122790 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d04f2591-f290-420f-9f71-24b9f265e11b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:27.128772 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d04f2591-f290-420f-9f71-24b9f265e11b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:27.129220 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d04f2591-f290-420f-9f71-24b9f265e11b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:27.130485 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d04f2591-f290-420f-9f71-24b9f265e11b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:27.131077 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d04f2591-f290-420f-9f71-24b9f265e11b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:27.137345 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-40e1b8e3-f326-43e9-bce6-1a5f74e32554 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:27.138193 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-40e1b8e3-f326-43e9-bce6-1a5f74e32554 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:27.144071 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-40e1b8e3-f326-43e9-bce6-1a5f74e32554 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:27.144515 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-40e1b8e3-f326-43e9-bce6-1a5f74e32554 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:27.145370 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-40e1b8e3-f326-43e9-bce6-1a5f74e32554 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:27.146482 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-40e1b8e3-f326-43e9-bce6-1a5f74e32554 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:27.334271 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d04f2591-f290-420f-9f71-24b9f265e11b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:27.337343 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-40e1b8e3-f326-43e9-bce6-1a5f74e32554 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:27.341667 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d04f2591-f290-420f-9f71-24b9f265e11b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.223097 Jan 19 13:05:27.342389 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 101/207] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:27 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:27.345220 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-40e1b8e3-f326-43e9-bce6-1a5f74e32554 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:27.346719 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-40e1b8e3-f326-43e9-bce6-1a5f74e32554 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:27.347826 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-40e1b8e3-f326-43e9-bce6-1a5f74e32554 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.214095 Jan 19 13:05:27.348396 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 107/208] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:27 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:27.839216 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1149cb24-00f8-48ea-a3f6-d62788107d57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:27.839845 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1149cb24-00f8-48ea-a3f6-d62788107d57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:27.845866 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2c4e8dbc-a238-48c2-b39c-6f0377882f83 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:27.846290 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1149cb24-00f8-48ea-a3f6-d62788107d57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:27.846420 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1149cb24-00f8-48ea-a3f6-d62788107d57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:27.846514 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2c4e8dbc-a238-48c2-b39c-6f0377882f83 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:27.847134 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1149cb24-00f8-48ea-a3f6-d62788107d57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:27.847562 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1149cb24-00f8-48ea-a3f6-d62788107d57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:27.852364 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2c4e8dbc-a238-48c2-b39c-6f0377882f83 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:27.852816 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2c4e8dbc-a238-48c2-b39c-6f0377882f83 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:27.853590 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2c4e8dbc-a238-48c2-b39c-6f0377882f83 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:27.854023 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2c4e8dbc-a238-48c2-b39c-6f0377882f83 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:28.044602 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-1149cb24-00f8-48ea-a3f6-d62788107d57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:28.047946 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2c4e8dbc-a238-48c2-b39c-6f0377882f83 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:28.051783 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1149cb24-00f8-48ea-a3f6-d62788107d57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.216094 Jan 19 13:05:28.052597 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 102/209] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:27 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:28.055287 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2c4e8dbc-a238-48c2-b39c-6f0377882f83 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.212990 Jan 19 13:05:28.055831 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 108/210] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:27 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:28.358849 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ca52c7a1-ce59-4f93-8f03-69c21ef814ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:28.359480 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ca52c7a1-ce59-4f93-8f03-69c21ef814ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:28.366301 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ca52c7a1-ce59-4f93-8f03-69c21ef814ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:28.366616 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-eeb1289a-487d-4626-b6bd-ed26c115e35b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:28.366749 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ca52c7a1-ce59-4f93-8f03-69c21ef814ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:28.367211 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-eeb1289a-487d-4626-b6bd-ed26c115e35b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:28.367506 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ca52c7a1-ce59-4f93-8f03-69c21ef814ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:28.367941 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ca52c7a1-ce59-4f93-8f03-69c21ef814ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:28.373031 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-eeb1289a-487d-4626-b6bd-ed26c115e35b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:28.373468 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-eeb1289a-487d-4626-b6bd-ed26c115e35b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:28.374221 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-eeb1289a-487d-4626-b6bd-ed26c115e35b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:28.374644 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-eeb1289a-487d-4626-b6bd-ed26c115e35b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:28.564225 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ca52c7a1-ce59-4f93-8f03-69c21ef814ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:28.567668 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-eeb1289a-487d-4626-b6bd-ed26c115e35b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:28.571889 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ca52c7a1-ce59-4f93-8f03-69c21ef814ce tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.216778 Jan 19 13:05:28.572543 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 103/211] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:28 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:28.575412 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-eeb1289a-487d-4626-b6bd-ed26c115e35b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:28.576922 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-eeb1289a-487d-4626-b6bd-ed26c115e35b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:28.578004 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-eeb1289a-487d-4626-b6bd-ed26c115e35b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.215738 Jan 19 13:05:28.578543 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 109/212] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:28 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:29.068587 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-45440496-8525-4cbd-a5db-aab9f424a46a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:29.069149 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-45440496-8525-4cbd-a5db-aab9f424a46a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:29.070979 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b4122b68-5f5e-4bb1-b70b-2c04f3e0c91a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:29.071612 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b4122b68-5f5e-4bb1-b70b-2c04f3e0c91a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:29.075211 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-45440496-8525-4cbd-a5db-aab9f424a46a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:29.075661 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-45440496-8525-4cbd-a5db-aab9f424a46a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:29.076477 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-45440496-8525-4cbd-a5db-aab9f424a46a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:29.076913 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-45440496-8525-4cbd-a5db-aab9f424a46a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:29.077366 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b4122b68-5f5e-4bb1-b70b-2c04f3e0c91a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:29.077819 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b4122b68-5f5e-4bb1-b70b-2c04f3e0c91a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:29.078595 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b4122b68-5f5e-4bb1-b70b-2c04f3e0c91a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:29.079032 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b4122b68-5f5e-4bb1-b70b-2c04f3e0c91a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:29.266797 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-45440496-8525-4cbd-a5db-aab9f424a46a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:29.270823 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b4122b68-5f5e-4bb1-b70b-2c04f3e0c91a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:29.274299 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-45440496-8525-4cbd-a5db-aab9f424a46a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.209415 Jan 19 13:05:29.274882 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 104/213] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:29 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:29.278333 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b4122b68-5f5e-4bb1-b70b-2c04f3e0c91a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.210894 Jan 19 13:05:29.279019 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 110/214] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:29 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:29.588470 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-dd98d345-2027-45b2-b38b-2d6367ca5e0b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:29.589072 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-dd98d345-2027-45b2-b38b-2d6367ca5e0b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:29.594153 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e804caf8-6e80-4ad9-b802-0ccfd9e8f0bc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:29.594757 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e804caf8-6e80-4ad9-b802-0ccfd9e8f0bc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:29.594941 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dd98d345-2027-45b2-b38b-2d6367ca5e0b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:29.595387 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dd98d345-2027-45b2-b38b-2d6367ca5e0b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:29.596184 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dd98d345-2027-45b2-b38b-2d6367ca5e0b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:29.596611 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dd98d345-2027-45b2-b38b-2d6367ca5e0b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:29.601043 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e804caf8-6e80-4ad9-b802-0ccfd9e8f0bc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:29.601494 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e804caf8-6e80-4ad9-b802-0ccfd9e8f0bc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:29.602273 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e804caf8-6e80-4ad9-b802-0ccfd9e8f0bc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:29.602704 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e804caf8-6e80-4ad9-b802-0ccfd9e8f0bc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:29.787601 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-dd98d345-2027-45b2-b38b-2d6367ca5e0b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:29.795192 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-dd98d345-2027-45b2-b38b-2d6367ca5e0b tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1315 microversion: 2.1 time: 0.210245 Jan 19 13:05:29.796389 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 105/215] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:29 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:29.799464 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-e804caf8-6e80-4ad9-b802-0ccfd9e8f0bc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:29.808920 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-e804caf8-6e80-4ad9-b802-0ccfd9e8f0bc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:29.810523 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-e804caf8-6e80-4ad9-b802-0ccfd9e8f0bc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:29.811682 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e804caf8-6e80-4ad9-b802-0ccfd9e8f0bc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.221153 Jan 19 13:05:29.812259 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 111/216] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:29 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:30.291277 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e29d00d7-6cf9-4c97-b70f-8166a9b38629 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:30.291800 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e29d00d7-6cf9-4c97-b70f-8166a9b38629 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:30.294539 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5f28575a-330c-4ec5-807a-c0d3ed1d89ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:30.295139 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5f28575a-330c-4ec5-807a-c0d3ed1d89ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:30.297563 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e29d00d7-6cf9-4c97-b70f-8166a9b38629 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:30.298014 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e29d00d7-6cf9-4c97-b70f-8166a9b38629 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:30.298859 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e29d00d7-6cf9-4c97-b70f-8166a9b38629 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:30.299324 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e29d00d7-6cf9-4c97-b70f-8166a9b38629 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:30.302445 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5f28575a-330c-4ec5-807a-c0d3ed1d89ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:30.302965 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5f28575a-330c-4ec5-807a-c0d3ed1d89ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:30.303791 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5f28575a-330c-4ec5-807a-c0d3ed1d89ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:30.304302 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5f28575a-330c-4ec5-807a-c0d3ed1d89ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:30.511584 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e29d00d7-6cf9-4c97-b70f-8166a9b38629 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:30.519282 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e29d00d7-6cf9-4c97-b70f-8166a9b38629 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.231837 Jan 19 13:05:30.519430 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5f28575a-330c-4ec5-807a-c0d3ed1d89ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:30.520033 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 106/217] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:30 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:30.527463 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5f28575a-330c-4ec5-807a-c0d3ed1d89ac tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.236778 Jan 19 13:05:30.528044 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 112/218] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:30 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:30.812667 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7eb8ac2a-3720-43a9-a8a5-b3339db7c4f1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:30.813172 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7eb8ac2a-3720-43a9-a8a5-b3339db7c4f1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:30.820747 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7eb8ac2a-3720-43a9-a8a5-b3339db7c4f1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:30.821016 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7eb8ac2a-3720-43a9-a8a5-b3339db7c4f1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:30.821790 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7eb8ac2a-3720-43a9-a8a5-b3339db7c4f1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:30.822503 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7eb8ac2a-3720-43a9-a8a5-b3339db7c4f1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:30.830070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9d321bd3-0a2d-4c40-ae75-64c380cabac0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:30.830596 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9d321bd3-0a2d-4c40-ae75-64c380cabac0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:30.837669 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9d321bd3-0a2d-4c40-ae75-64c380cabac0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:30.838118 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9d321bd3-0a2d-4c40-ae75-64c380cabac0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:30.838900 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9d321bd3-0a2d-4c40-ae75-64c380cabac0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:30.839397 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9d321bd3-0a2d-4c40-ae75-64c380cabac0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:31.045763 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-7eb8ac2a-3720-43a9-a8a5-b3339db7c4f1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:31.059592 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7eb8ac2a-3720-43a9-a8a5-b3339db7c4f1 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1502 microversion: 2.1 time: 0.250782 Jan 19 13:05:31.073786 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 107/219] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:30 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1502 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:31.085440 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-9d321bd3-0a2d-4c40-ae75-64c380cabac0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:31.095046 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-9d321bd3-0a2d-4c40-ae75-64c380cabac0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:31.096687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-9d321bd3-0a2d-4c40-ae75-64c380cabac0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:31.097880 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9d321bd3-0a2d-4c40-ae75-64c380cabac0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.271497 Jan 19 13:05:31.099464 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 113/220] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:30 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:05:31.157564 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-15f9c979-3e98-4f68-a7d8-cce0ccc0632e req-02b160bc-7278-4cb4-90cb-26a070eef078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b74c954-19e1-498d-a9b6-c0fb2663635a", "name": "network-vif-plugged", "status": "completed", "tag": "f0c36288-465f-49ee-ad3b-75329de2fc61"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:31.159445 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:05:31.159445 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:05:31.169616 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-15f9c979-3e98-4f68-a7d8-cce0ccc0632e req-02b160bc-7278-4cb4-90cb-26a070eef078 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:31.170419 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-15f9c979-3e98-4f68-a7d8-cce0ccc0632e req-02b160bc-7278-4cb4-90cb-26a070eef078 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:31.188634 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-15f9c979-3e98-4f68-a7d8-cce0ccc0632e req-02b160bc-7278-4cb4-90cb-26a070eef078 service nova] Creating event network-vif-plugged:f0c36288-465f-49ee-ad3b-75329de2fc61 for instance 9b74c954-19e1-498d-a9b6-c0fb2663635a on hv-cinder-82301 Jan 19 13:05:31.194310 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-15f9c979-3e98-4f68-a7d8-cce0ccc0632e req-02b160bc-7278-4cb4-90cb-26a070eef078 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041318 Jan 19 13:05:31.195266 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 108/221] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:05:31.546244 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-54d4f55e-1248-4a5f-9be1-2b89f73788b0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:31.546936 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-54d4f55e-1248-4a5f-9be1-2b89f73788b0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:31.553749 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4cba18b6-a27a-443a-878d-b6c24bf27748 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:31.554996 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4cba18b6-a27a-443a-878d-b6c24bf27748 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:31.574026 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54d4f55e-1248-4a5f-9be1-2b89f73788b0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:31.574215 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4cba18b6-a27a-443a-878d-b6c24bf27748 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:31.574920 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4cba18b6-a27a-443a-878d-b6c24bf27748 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:31.575864 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4cba18b6-a27a-443a-878d-b6c24bf27748 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:31.576473 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4cba18b6-a27a-443a-878d-b6c24bf27748 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:31.581230 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54d4f55e-1248-4a5f-9be1-2b89f73788b0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:31.582392 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54d4f55e-1248-4a5f-9be1-2b89f73788b0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:31.583803 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54d4f55e-1248-4a5f-9be1-2b89f73788b0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:31.809605 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-54d4f55e-1248-4a5f-9be1-2b89f73788b0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:31.826662 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-54d4f55e-1248-4a5f-9be1-2b89f73788b0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.284656 Jan 19 13:05:31.838020 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 109/222] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:31 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:31.852442 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4cba18b6-a27a-443a-878d-b6c24bf27748 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:31.860104 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4cba18b6-a27a-443a-878d-b6c24bf27748 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.327149 Jan 19 13:05:31.870973 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 114/223] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:31 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:32.116839 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5b36f9d9-2d9d-4255-bc0d-7ee495d6ab2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:32.117446 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5b36f9d9-2d9d-4255-bc0d-7ee495d6ab2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:32.123147 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5b36f9d9-2d9d-4255-bc0d-7ee495d6ab2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:32.123595 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5b36f9d9-2d9d-4255-bc0d-7ee495d6ab2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:32.124399 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5b36f9d9-2d9d-4255-bc0d-7ee495d6ab2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:32.124830 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5b36f9d9-2d9d-4255-bc0d-7ee495d6ab2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:32.261357 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5b36f9d9-2d9d-4255-bc0d-7ee495d6ab2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:32.270827 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5b36f9d9-2d9d-4255-bc0d-7ee495d6ab2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:32.272643 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5b36f9d9-2d9d-4255-bc0d-7ee495d6ab2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:32.274007 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5b36f9d9-2d9d-4255-bc0d-7ee495d6ab2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.161000 Jan 19 13:05:32.274724 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 110/224] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:32 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:05:32.844005 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a02672f3-6e11-493f-b0ce-9c8953f45ef5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:32.844612 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a02672f3-6e11-493f-b0ce-9c8953f45ef5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:32.850970 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a02672f3-6e11-493f-b0ce-9c8953f45ef5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:32.851410 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a02672f3-6e11-493f-b0ce-9c8953f45ef5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:32.852205 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a02672f3-6e11-493f-b0ce-9c8953f45ef5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:32.852706 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a02672f3-6e11-493f-b0ce-9c8953f45ef5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:32.877390 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a747ee59-99d9-4c3d-aef5-2abf4f591e02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:32.878662 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a747ee59-99d9-4c3d-aef5-2abf4f591e02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:32.885414 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a747ee59-99d9-4c3d-aef5-2abf4f591e02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:32.886002 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a747ee59-99d9-4c3d-aef5-2abf4f591e02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:32.886884 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a747ee59-99d9-4c3d-aef5-2abf4f591e02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:32.887423 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a747ee59-99d9-4c3d-aef5-2abf4f591e02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:33.026806 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a02672f3-6e11-493f-b0ce-9c8953f45ef5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:33.040311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a02672f3-6e11-493f-b0ce-9c8953f45ef5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.199353 Jan 19 13:05:33.049692 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 115/225] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:32 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:33.071485 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-a747ee59-99d9-4c3d-aef5-2abf4f591e02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:33.080412 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a747ee59-99d9-4c3d-aef5-2abf4f591e02 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.206834 Jan 19 13:05:33.080991 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 111/226] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:32 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:33.246136 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-748db9b9-70cc-4700-bd98-03a19a274e92 req-3910b376-38a9-4f2b-923f-3e36e9fc5095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c0570c-1d8d-41ff-9ec2-9325d1a121ca", "name": "network-vif-plugged", "status": "completed", "tag": "ffc3ee9b-e03d-44c4-a33d-39af979abf14"}, {"server_uuid": "5a7999cb-80e5-4ad9-aed4-efea6e23ffa7", "name": "network-vif-plugged", "status": "completed", "tag": "958818e4-6792-4499-aa84-8ad5cc852465"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:33.248006 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:05:33.248006 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:05:33.256322 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-748db9b9-70cc-4700-bd98-03a19a274e92 req-3910b376-38a9-4f2b-923f-3e36e9fc5095 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:33.256953 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-748db9b9-70cc-4700-bd98-03a19a274e92 req-3910b376-38a9-4f2b-923f-3e36e9fc5095 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:33.271835 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-748db9b9-70cc-4700-bd98-03a19a274e92 req-3910b376-38a9-4f2b-923f-3e36e9fc5095 service nova] Creating event network-vif-plugged:ffc3ee9b-e03d-44c4-a33d-39af979abf14 for instance e4c0570c-1d8d-41ff-9ec2-9325d1a121ca on hv-cinder-82301 Jan 19 13:05:33.272364 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-748db9b9-70cc-4700-bd98-03a19a274e92 req-3910b376-38a9-4f2b-923f-3e36e9fc5095 service nova] Creating event network-vif-plugged:958818e4-6792-4499-aa84-8ad5cc852465 for instance 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 on hv-cinder-82301 Jan 19 13:05:33.278916 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-748db9b9-70cc-4700-bd98-03a19a274e92 req-3910b376-38a9-4f2b-923f-3e36e9fc5095 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036374 Jan 19 13:05:33.279684 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 116/227] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:05:33.292416 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e3cf8af5-7a56-43bb-b952-6abfed5f5709 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:33.293020 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e3cf8af5-7a56-43bb-b952-6abfed5f5709 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:33.303740 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3cf8af5-7a56-43bb-b952-6abfed5f5709 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:33.304111 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3cf8af5-7a56-43bb-b952-6abfed5f5709 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:33.304985 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3cf8af5-7a56-43bb-b952-6abfed5f5709 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:33.305324 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3cf8af5-7a56-43bb-b952-6abfed5f5709 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:33.451127 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e3cf8af5-7a56-43bb-b952-6abfed5f5709 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:33.459654 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e3cf8af5-7a56-43bb-b952-6abfed5f5709 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:33.461196 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e3cf8af5-7a56-43bb-b952-6abfed5f5709 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:33.462298 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e3cf8af5-7a56-43bb-b952-6abfed5f5709 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.173862 Jan 19 13:05:33.462859 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 112/228] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:33 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:05:34.058294 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a2c79915-4684-45a0-86ae-059fb566ad75 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:34.059021 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a2c79915-4684-45a0-86ae-059fb566ad75 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:34.065540 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a2c79915-4684-45a0-86ae-059fb566ad75 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:34.065999 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a2c79915-4684-45a0-86ae-059fb566ad75 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:34.066830 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a2c79915-4684-45a0-86ae-059fb566ad75 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:34.067761 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a2c79915-4684-45a0-86ae-059fb566ad75 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:34.097314 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-41eff00e-5b3e-479d-ab55-d57030b023a0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:34.097944 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-41eff00e-5b3e-479d-ab55-d57030b023a0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:34.103758 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-41eff00e-5b3e-479d-ab55-d57030b023a0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:34.104250 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-41eff00e-5b3e-479d-ab55-d57030b023a0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:34.105030 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-41eff00e-5b3e-479d-ab55-d57030b023a0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:34.105466 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-41eff00e-5b3e-479d-ab55-d57030b023a0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:34.230120 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a2c79915-4684-45a0-86ae-059fb566ad75 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:34.238049 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a2c79915-4684-45a0-86ae-059fb566ad75 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.183892 Jan 19 13:05:34.239416 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 117/229] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:34 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:34.278174 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-41eff00e-5b3e-479d-ab55-d57030b023a0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:34.285300 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-41eff00e-5b3e-479d-ab55-d57030b023a0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.191600 Jan 19 13:05:34.285851 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 113/230] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:34 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:34.480421 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d90b73ea-8c55-426a-ad79-cc893d5287b8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:34.481013 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d90b73ea-8c55-426a-ad79-cc893d5287b8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:34.486704 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d90b73ea-8c55-426a-ad79-cc893d5287b8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:34.487142 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d90b73ea-8c55-426a-ad79-cc893d5287b8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:34.487899 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d90b73ea-8c55-426a-ad79-cc893d5287b8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:34.488352 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d90b73ea-8c55-426a-ad79-cc893d5287b8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:34.617712 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d90b73ea-8c55-426a-ad79-cc893d5287b8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:34.627014 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d90b73ea-8c55-426a-ad79-cc893d5287b8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:34.628560 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d90b73ea-8c55-426a-ad79-cc893d5287b8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:34.629650 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d90b73ea-8c55-426a-ad79-cc893d5287b8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.152845 Jan 19 13:05:34.630191 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 118/231] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:34 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:05:35.255522 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-90edf1fa-1621-44f5-a3b9-02749bc6edc0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:35.256201 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-90edf1fa-1621-44f5-a3b9-02749bc6edc0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:35.262122 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-90edf1fa-1621-44f5-a3b9-02749bc6edc0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:35.262824 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-90edf1fa-1621-44f5-a3b9-02749bc6edc0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:35.263603 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-90edf1fa-1621-44f5-a3b9-02749bc6edc0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:35.264434 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-90edf1fa-1621-44f5-a3b9-02749bc6edc0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:35.293412 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-1841ac63-9426-487e-a1ae-fa594161fa22 req-7dcca5c5-02d8-48c4-b530-8d6a9ac26da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2fc94f-e55f-4947-9824-ffc6edf35e0c", "name": "network-vif-plugged", "status": "completed", "tag": "7e0a83a8-36d8-4d5c-baf5-d9396dafdb38"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:35.295044 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:05:35.295044 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:05:35.302250 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-1841ac63-9426-487e-a1ae-fa594161fa22 req-7dcca5c5-02d8-48c4-b530-8d6a9ac26da5 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:35.302831 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-1841ac63-9426-487e-a1ae-fa594161fa22 req-7dcca5c5-02d8-48c4-b530-8d6a9ac26da5 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:35.313632 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-1841ac63-9426-487e-a1ae-fa594161fa22 req-7dcca5c5-02d8-48c4-b530-8d6a9ac26da5 service nova] Creating event network-vif-plugged:7e0a83a8-36d8-4d5c-baf5-d9396dafdb38 for instance 0a2fc94f-e55f-4947-9824-ffc6edf35e0c on hv-cinder-82301 Jan 19 13:05:35.319224 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-1841ac63-9426-487e-a1ae-fa594161fa22 req-7dcca5c5-02d8-48c4-b530-8d6a9ac26da5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029345 Jan 19 13:05:35.319824 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 119/232] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:05:35.324621 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-907dda9f-0e8a-47b4-b5e3-b4a59d5ecd05 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:35.325336 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-907dda9f-0e8a-47b4-b5e3-b4a59d5ecd05 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:35.331185 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-907dda9f-0e8a-47b4-b5e3-b4a59d5ecd05 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:35.331636 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-907dda9f-0e8a-47b4-b5e3-b4a59d5ecd05 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:35.332439 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-907dda9f-0e8a-47b4-b5e3-b4a59d5ecd05 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:35.333502 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-907dda9f-0e8a-47b4-b5e3-b4a59d5ecd05 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:35.422596 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-90edf1fa-1621-44f5-a3b9-02749bc6edc0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:35.429952 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-90edf1fa-1621-44f5-a3b9-02749bc6edc0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.178699 Jan 19 13:05:35.430515 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 114/233] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:35 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:35.483687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-907dda9f-0e8a-47b4-b5e3-b4a59d5ecd05 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:35.491718 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-907dda9f-0e8a-47b4-b5e3-b4a59d5ecd05 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.170753 Jan 19 13:05:35.492466 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 120/234] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:35 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:35.646859 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-edd0545c-196e-4ba9-89da-185af27f8abc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:35.647456 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-edd0545c-196e-4ba9-89da-185af27f8abc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:35.653242 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-edd0545c-196e-4ba9-89da-185af27f8abc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:35.653692 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-edd0545c-196e-4ba9-89da-185af27f8abc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:35.654506 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-edd0545c-196e-4ba9-89da-185af27f8abc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:35.654885 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-edd0545c-196e-4ba9-89da-185af27f8abc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:35.782081 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-edd0545c-196e-4ba9-89da-185af27f8abc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:35.789940 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-edd0545c-196e-4ba9-89da-185af27f8abc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:35.791443 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-edd0545c-196e-4ba9-89da-185af27f8abc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:35.792556 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-edd0545c-196e-4ba9-89da-185af27f8abc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.149909 Jan 19 13:05:35.793099 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 115/235] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:35 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:05:36.446915 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-facfa972-e3a8-4b2d-b487-807910e18461 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:36.447546 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-facfa972-e3a8-4b2d-b487-807910e18461 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:36.453384 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-facfa972-e3a8-4b2d-b487-807910e18461 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:36.453832 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-facfa972-e3a8-4b2d-b487-807910e18461 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:36.454600 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-facfa972-e3a8-4b2d-b487-807910e18461 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:36.455031 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-facfa972-e3a8-4b2d-b487-807910e18461 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:36.507630 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c6b680fa-8007-4dc6-8e3d-3e618dd4e921 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:36.508445 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c6b680fa-8007-4dc6-8e3d-3e618dd4e921 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:36.514564 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c6b680fa-8007-4dc6-8e3d-3e618dd4e921 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:36.515018 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c6b680fa-8007-4dc6-8e3d-3e618dd4e921 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:36.515790 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c6b680fa-8007-4dc6-8e3d-3e618dd4e921 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:36.516253 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c6b680fa-8007-4dc6-8e3d-3e618dd4e921 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:36.614660 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-facfa972-e3a8-4b2d-b487-807910e18461 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:36.621697 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-facfa972-e3a8-4b2d-b487-807910e18461 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.178714 Jan 19 13:05:36.622261 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 121/236] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:36 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:36.674811 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-c6b680fa-8007-4dc6-8e3d-3e618dd4e921 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:36.682893 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c6b680fa-8007-4dc6-8e3d-3e618dd4e921 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.178874 Jan 19 13:05:36.683460 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 116/237] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:36 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:36.811250 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-bae70925-b0f2-4fcb-b9ba-0094d77f87ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:36.811835 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-bae70925-b0f2-4fcb-b9ba-0094d77f87ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:36.818078 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bae70925-b0f2-4fcb-b9ba-0094d77f87ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:36.818517 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bae70925-b0f2-4fcb-b9ba-0094d77f87ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:36.819275 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bae70925-b0f2-4fcb-b9ba-0094d77f87ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:36.819700 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bae70925-b0f2-4fcb-b9ba-0094d77f87ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:36.950691 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bae70925-b0f2-4fcb-b9ba-0094d77f87ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:36.959104 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bae70925-b0f2-4fcb-b9ba-0094d77f87ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:36.960627 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bae70925-b0f2-4fcb-b9ba-0094d77f87ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:36.961743 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-bae70925-b0f2-4fcb-b9ba-0094d77f87ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.154716 Jan 19 13:05:36.962291 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 122/238] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:36 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:05:37.638360 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f038d13b-6b90-4b77-8190-8db707d11c42 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:37.639246 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f038d13b-6b90-4b77-8190-8db707d11c42 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:37.645193 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f038d13b-6b90-4b77-8190-8db707d11c42 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:37.645904 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f038d13b-6b90-4b77-8190-8db707d11c42 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:37.646710 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f038d13b-6b90-4b77-8190-8db707d11c42 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:37.647145 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f038d13b-6b90-4b77-8190-8db707d11c42 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:37.698292 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5a329fa2-c45c-49c8-a54e-cc7530ee4b3a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:37.698986 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5a329fa2-c45c-49c8-a54e-cc7530ee4b3a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:37.704697 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5a329fa2-c45c-49c8-a54e-cc7530ee4b3a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:37.705146 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5a329fa2-c45c-49c8-a54e-cc7530ee4b3a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:37.705912 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5a329fa2-c45c-49c8-a54e-cc7530ee4b3a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:37.706345 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5a329fa2-c45c-49c8-a54e-cc7530ee4b3a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:37.804835 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f038d13b-6b90-4b77-8190-8db707d11c42 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:37.812075 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f038d13b-6b90-4b77-8190-8db707d11c42 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.177510 Jan 19 13:05:37.812640 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 117/239] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:37 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:37.817582 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1cb325cf-65dd-4812-80b4-e349cfbdecd8 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a516b7a-da32-4b5c-8783-2b32647331a1"}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:37.818932 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1cb325cf-65dd-4812-80b4-e349cfbdecd8 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:37.824666 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1cb325cf-65dd-4812-80b4-e349cfbdecd8 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:37.825113 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1cb325cf-65dd-4812-80b4-e349cfbdecd8 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:37.825889 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1cb325cf-65dd-4812-80b4-e349cfbdecd8 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:37.826326 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1cb325cf-65dd-4812-80b4-e349cfbdecd8 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:37.865038 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5a329fa2-c45c-49c8-a54e-cc7530ee4b3a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:37.871936 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5a329fa2-c45c-49c8-a54e-cc7530ee4b3a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.177249 Jan 19 13:05:37.881371 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 123/240] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:37 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:37.978627 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2dc5e89c-ba7f-4b64-821b-95a391a2746a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:37.979133 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2dc5e89c-ba7f-4b64-821b-95a391a2746a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:37.985415 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2dc5e89c-ba7f-4b64-821b-95a391a2746a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:37.985854 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2dc5e89c-ba7f-4b64-821b-95a391a2746a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:37.987033 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2dc5e89c-ba7f-4b64-821b-95a391a2746a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:37.987549 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2dc5e89c-ba7f-4b64-821b-95a391a2746a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:38.126225 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2dc5e89c-ba7f-4b64-821b-95a391a2746a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:38.135100 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2dc5e89c-ba7f-4b64-821b-95a391a2746a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:38.136646 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2dc5e89c-ba7f-4b64-821b-95a391a2746a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:38.138022 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2dc5e89c-ba7f-4b64-821b-95a391a2746a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.162802 Jan 19 13:05:38.138641 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 124/241] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:37 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:05:38.159135 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1cb325cf-65dd-4812-80b4-e349cfbdecd8 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "POST /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345179 Jan 19 13:05:38.159831 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 118/242] 10.222.0.48 () {60 vars in 1322 bytes} [Wed Jan 19 13:05:37 2022] POST /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:05:38.828341 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-17cee8ea-b7ff-4e7e-9cf6-8c16e881dd5f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:38.828863 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-17cee8ea-b7ff-4e7e-9cf6-8c16e881dd5f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:38.835181 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-17cee8ea-b7ff-4e7e-9cf6-8c16e881dd5f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:38.835622 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-17cee8ea-b7ff-4e7e-9cf6-8c16e881dd5f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:38.836409 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-17cee8ea-b7ff-4e7e-9cf6-8c16e881dd5f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:38.836843 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-17cee8ea-b7ff-4e7e-9cf6-8c16e881dd5f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:38.889797 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a7671cbf-415e-43fe-937f-e7b4b7207b8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:38.890631 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a7671cbf-415e-43fe-937f-e7b4b7207b8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:38.899387 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a7671cbf-415e-43fe-937f-e7b4b7207b8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:38.899931 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a7671cbf-415e-43fe-937f-e7b4b7207b8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:38.900744 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a7671cbf-415e-43fe-937f-e7b4b7207b8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:38.901184 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a7671cbf-415e-43fe-937f-e7b4b7207b8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:38.995892 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-17cee8ea-b7ff-4e7e-9cf6-8c16e881dd5f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:39.003063 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-17cee8ea-b7ff-4e7e-9cf6-8c16e881dd5f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1361 microversion: 2.1 time: 0.178394 Jan 19 13:05:39.003624 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 125/243] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:38 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:39.069647 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-a7671cbf-415e-43fe-937f-e7b4b7207b8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:39.079201 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a7671cbf-415e-43fe-937f-e7b4b7207b8e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1322 microversion: 2.1 time: 0.193772 Jan 19 13:05:39.079777 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 119/244] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:38 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:39.156471 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4c0f4603-bc1d-4cc0-b98d-624dc9b0bee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:39.157071 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4c0f4603-bc1d-4cc0-b98d-624dc9b0bee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:39.163960 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c0f4603-bc1d-4cc0-b98d-624dc9b0bee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:39.164659 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c0f4603-bc1d-4cc0-b98d-624dc9b0bee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:39.166221 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c0f4603-bc1d-4cc0-b98d-624dc9b0bee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:39.166760 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c0f4603-bc1d-4cc0-b98d-624dc9b0bee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:39.305294 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4c0f4603-bc1d-4cc0-b98d-624dc9b0bee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:39.313012 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4c0f4603-bc1d-4cc0-b98d-624dc9b0bee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:39.314521 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4c0f4603-bc1d-4cc0-b98d-624dc9b0bee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:39.315628 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4c0f4603-bc1d-4cc0-b98d-624dc9b0bee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.162839 Jan 19 13:05:39.316218 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 126/245] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:39 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:05:40.021060 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f0b69440-fc49-44f0-8ab4-6faf60d7b969 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:40.021583 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f0b69440-fc49-44f0-8ab4-6faf60d7b969 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:40.028566 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f0b69440-fc49-44f0-8ab4-6faf60d7b969 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:40.029021 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f0b69440-fc49-44f0-8ab4-6faf60d7b969 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:40.029797 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f0b69440-fc49-44f0-8ab4-6faf60d7b969 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:40.030233 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f0b69440-fc49-44f0-8ab4-6faf60d7b969 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:40.096564 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7fd9e490-b88e-4ca8-bc3c-1001ee708bd6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:40.097175 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7fd9e490-b88e-4ca8-bc3c-1001ee708bd6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:40.103357 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fd9e490-b88e-4ca8-bc3c-1001ee708bd6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:40.103803 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fd9e490-b88e-4ca8-bc3c-1001ee708bd6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:40.104610 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fd9e490-b88e-4ca8-bc3c-1001ee708bd6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:40.105046 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fd9e490-b88e-4ca8-bc3c-1001ee708bd6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:40.184219 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f0b69440-fc49-44f0-8ab4-6faf60d7b969 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:40.191482 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f0b69440-fc49-44f0-8ab4-6faf60d7b969 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1547 microversion: 2.1 time: 0.174231 Jan 19 13:05:40.192875 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 120/246] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:40 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1547 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:40.208473 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-33a29678-34f9-4694-853d-f8b5bb73dd96 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:40.208998 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-33a29678-34f9-4694-853d-f8b5bb73dd96 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:40.214943 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33a29678-34f9-4694-853d-f8b5bb73dd96 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:40.215398 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33a29678-34f9-4694-853d-f8b5bb73dd96 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:40.216205 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33a29678-34f9-4694-853d-f8b5bb73dd96 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:40.216649 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33a29678-34f9-4694-853d-f8b5bb73dd96 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:40.267900 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7fd9e490-b88e-4ca8-bc3c-1001ee708bd6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:40.275298 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7fd9e490-b88e-4ca8-bc3c-1001ee708bd6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1516 microversion: 2.1 time: 0.182274 Jan 19 13:05:40.275794 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 127/247] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:40 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:40.292550 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-227645b3-986a-41e9-ae04-6dd8fe1f328f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:40.293615 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-227645b3-986a-41e9-ae04-6dd8fe1f328f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:40.299455 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-227645b3-986a-41e9-ae04-6dd8fe1f328f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:40.300142 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-227645b3-986a-41e9-ae04-6dd8fe1f328f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:40.300920 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-227645b3-986a-41e9-ae04-6dd8fe1f328f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:40.302069 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-227645b3-986a-41e9-ae04-6dd8fe1f328f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:40.306393 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-33a29678-34f9-4694-853d-f8b5bb73dd96 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101614 Jan 19 13:05:40.306998 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 121/248] 10.222.0.48 () {58 vars in 1274 bytes} [Wed Jan 19 13:05:40 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:05:40.337915 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e1f815e0-2e17-44a7-ab48-ad95e6ec018d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:40.338750 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e1f815e0-2e17-44a7-ab48-ad95e6ec018d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:40.344794 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e1f815e0-2e17-44a7-ab48-ad95e6ec018d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:40.345351 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e1f815e0-2e17-44a7-ab48-ad95e6ec018d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:40.346279 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e1f815e0-2e17-44a7-ab48-ad95e6ec018d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:40.346816 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e1f815e0-2e17-44a7-ab48-ad95e6ec018d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:40.363350 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.objects.instance [None req-227645b3-986a-41e9-ae04-6dd8fe1f328f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lazy-loading 'flavor' on Instance uuid 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 {{(pid=116360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:05:40.502928 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e1f815e0-2e17-44a7-ab48-ad95e6ec018d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:40.512157 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e1f815e0-2e17-44a7-ab48-ad95e6ec018d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:40.514088 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e1f815e0-2e17-44a7-ab48-ad95e6ec018d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:40.515657 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e1f815e0-2e17-44a7-ab48-ad95e6ec018d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.181439 Jan 19 13:05:40.516436 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 122/249] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:40 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:05:40.616664 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-227645b3-986a-41e9-ae04-6dd8fe1f328f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "POST /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7/action" status: 200 len: 32 microversion: 2.1 time: 0.327989 Jan 19 13:05:40.617285 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 128/250] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:05:40 2022] POST /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7/action => generated 32 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 13:05:40.626045 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-38d505ff-9f25-49f3-8d86-da29136dccaf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:40.626775 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-38d505ff-9f25-49f3-8d86-da29136dccaf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:40.633273 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-38d505ff-9f25-49f3-8d86-da29136dccaf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:40.633803 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-38d505ff-9f25-49f3-8d86-da29136dccaf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:40.634655 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-38d505ff-9f25-49f3-8d86-da29136dccaf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:40.635167 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-38d505ff-9f25-49f3-8d86-da29136dccaf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:40.767650 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-38d505ff-9f25-49f3-8d86-da29136dccaf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:40.776279 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-38d505ff-9f25-49f3-8d86-da29136dccaf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.154018 Jan 19 13:05:40.776850 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 123/251] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:40 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:41.463332 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6bf4b613-2056-4793-89cf-4f0aa1d6847d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:41.464959 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6bf4b613-2056-4793-89cf-4f0aa1d6847d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:41.465534 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-7f32240a-b18e-485a-9547-426b08b585aa req-fd988e64-0aed-4118-b1f9-ac25fda16ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c0570c-1d8d-41ff-9ec2-9325d1a121ca", "tag": "ffc3ee9b-e03d-44c4-a33d-39af979abf14"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:41.468410 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:05:41.468410 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:05:41.472536 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6bf4b613-2056-4793-89cf-4f0aa1d6847d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:41.473880 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6bf4b613-2056-4793-89cf-4f0aa1d6847d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:41.474681 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6bf4b613-2056-4793-89cf-4f0aa1d6847d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:41.475118 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6bf4b613-2056-4793-89cf-4f0aa1d6847d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:41.479854 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-7f32240a-b18e-485a-9547-426b08b585aa req-fd988e64-0aed-4118-b1f9-ac25fda16ff4 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:41.480517 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-7f32240a-b18e-485a-9547-426b08b585aa req-fd988e64-0aed-4118-b1f9-ac25fda16ff4 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:41.633150 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-7f32240a-b18e-485a-9547-426b08b585aa req-fd988e64-0aed-4118-b1f9-ac25fda16ff4 service nova] Creating event network-changed:ffc3ee9b-e03d-44c4-a33d-39af979abf14 for instance e4c0570c-1d8d-41ff-9ec2-9325d1a121ca on hv-cinder-82301 Jan 19 13:05:41.638460 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-7f32240a-b18e-485a-9547-426b08b585aa req-fd988e64-0aed-4118-b1f9-ac25fda16ff4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176935 Jan 19 13:05:41.639067 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 124/252] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:05:41.646320 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6e14a7df-92c7-4912-a476-c2b11d4da2c4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:41.646465 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6e14a7df-92c7-4912-a476-c2b11d4da2c4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:41.652593 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6e14a7df-92c7-4912-a476-c2b11d4da2c4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:41.653047 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6e14a7df-92c7-4912-a476-c2b11d4da2c4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:41.653863 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6e14a7df-92c7-4912-a476-c2b11d4da2c4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:41.654302 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6e14a7df-92c7-4912-a476-c2b11d4da2c4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:41.783042 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6e14a7df-92c7-4912-a476-c2b11d4da2c4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:41.792510 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6e14a7df-92c7-4912-a476-c2b11d4da2c4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:41.793997 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6e14a7df-92c7-4912-a476-c2b11d4da2c4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:41.798861 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6e14a7df-92c7-4912-a476-c2b11d4da2c4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.153463 Jan 19 13:05:41.798861 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 125/253] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:41 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:05:41.799684 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-525048fe-9456-4696-8c37-670e89be752c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:41.800302 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-525048fe-9456-4696-8c37-670e89be752c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:41.806757 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-525048fe-9456-4696-8c37-670e89be752c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:41.807199 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-525048fe-9456-4696-8c37-670e89be752c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:41.807960 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-525048fe-9456-4696-8c37-670e89be752c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:41.808418 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-525048fe-9456-4696-8c37-670e89be752c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:41.946713 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-525048fe-9456-4696-8c37-670e89be752c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:41.954131 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-525048fe-9456-4696-8c37-670e89be752c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.157539 Jan 19 13:05:41.954693 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 126/254] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:41 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:42.812772 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e346789d-f8d2-49d0-8a77-ef383af2d0ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:42.813354 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e346789d-f8d2-49d0-8a77-ef383af2d0ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:42.819880 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e346789d-f8d2-49d0-8a77-ef383af2d0ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:42.820853 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e346789d-f8d2-49d0-8a77-ef383af2d0ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:42.821128 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e346789d-f8d2-49d0-8a77-ef383af2d0ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:42.821559 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e346789d-f8d2-49d0-8a77-ef383af2d0ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:42.945631 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e346789d-f8d2-49d0-8a77-ef383af2d0ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:42.953942 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e346789d-f8d2-49d0-8a77-ef383af2d0ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:42.955499 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e346789d-f8d2-49d0-8a77-ef383af2d0ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:42.956623 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e346789d-f8d2-49d0-8a77-ef383af2d0ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.147548 Jan 19 13:05:42.957187 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 127/255] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:42 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:42.969789 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-10307f26-bd1b-4c94-a43b-2aab4c37db97 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:42.970445 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-10307f26-bd1b-4c94-a43b-2aab4c37db97 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:42.976815 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-10307f26-bd1b-4c94-a43b-2aab4c37db97 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:42.977268 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-10307f26-bd1b-4c94-a43b-2aab4c37db97 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:42.978058 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-10307f26-bd1b-4c94-a43b-2aab4c37db97 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:42.978493 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-10307f26-bd1b-4c94-a43b-2aab4c37db97 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:43.108434 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-10307f26-bd1b-4c94-a43b-2aab4c37db97 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:43.116437 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-10307f26-bd1b-4c94-a43b-2aab4c37db97 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.149921 Jan 19 13:05:43.117009 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 128/256] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:42 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:43.974996 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-870db700-6c11-4ca4-bd5e-02897112e0fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:43.975590 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-870db700-6c11-4ca4-bd5e-02897112e0fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:43.981833 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-870db700-6c11-4ca4-bd5e-02897112e0fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:43.982285 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-870db700-6c11-4ca4-bd5e-02897112e0fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:43.983054 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-870db700-6c11-4ca4-bd5e-02897112e0fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:43.983491 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-870db700-6c11-4ca4-bd5e-02897112e0fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:44.120647 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-870db700-6c11-4ca4-bd5e-02897112e0fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:44.128498 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-870db700-6c11-4ca4-bd5e-02897112e0fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:44.130751 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-870db700-6c11-4ca4-bd5e-02897112e0fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:44.131854 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-870db700-6c11-4ca4-bd5e-02897112e0fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1407 microversion: 2.20 time: 0.161264 Jan 19 13:05:44.132442 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 129/257] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:43 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:05:44.136598 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-52161a89-1320-42b6-b8a7-3287ccb0a2e9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:44.137195 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-52161a89-1320-42b6-b8a7-3287ccb0a2e9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:44.143547 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-52161a89-1320-42b6-b8a7-3287ccb0a2e9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:44.144011 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-52161a89-1320-42b6-b8a7-3287ccb0a2e9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:44.145351 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-52161a89-1320-42b6-b8a7-3287ccb0a2e9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:44.145933 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-52161a89-1320-42b6-b8a7-3287ccb0a2e9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:44.154505 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6bf4b613-2056-4793-89cf-4f0aa1d6847d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 14 microversion: 2.1 time: 2.695029 Jan 19 13:05:44.155588 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 129/258] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:05:41 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 14 bytes in 2697 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:05:44.425560 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-52161a89-1320-42b6-b8a7-3287ccb0a2e9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:44.434262 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-52161a89-1320-42b6-b8a7-3287ccb0a2e9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.300752 Jan 19 13:05:44.443970 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 130/259] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:44 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:45.156136 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b57f68ee-6261-43ea-ad63-b25d5d4bab54 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:45.156826 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b57f68ee-6261-43ea-ad63-b25d5d4bab54 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:45.164525 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b57f68ee-6261-43ea-ad63-b25d5d4bab54 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:45.164973 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b57f68ee-6261-43ea-ad63-b25d5d4bab54 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:45.165751 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b57f68ee-6261-43ea-ad63-b25d5d4bab54 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:45.165902 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-78cfe1a2-992a-46e9-b538-a5dd8ef238ba tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:45.166350 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b57f68ee-6261-43ea-ad63-b25d5d4bab54 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:45.166860 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-78cfe1a2-992a-46e9-b538-a5dd8ef238ba tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:45.173313 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-78cfe1a2-992a-46e9-b538-a5dd8ef238ba tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:45.173756 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-78cfe1a2-992a-46e9-b538-a5dd8ef238ba tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:45.174616 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-78cfe1a2-992a-46e9-b538-a5dd8ef238ba tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:45.175365 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-78cfe1a2-992a-46e9-b538-a5dd8ef238ba tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:45.258279 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-78cfe1a2-992a-46e9-b538-a5dd8ef238ba tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 14 microversion: 2.1 time: 0.096033 Jan 19 13:05:45.261718 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 131/260] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:05:45 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:05:45.316451 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b57f68ee-6261-43ea-ad63-b25d5d4bab54 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:45.324534 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b57f68ee-6261-43ea-ad63-b25d5d4bab54 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:45.326914 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b57f68ee-6261-43ea-ad63-b25d5d4bab54 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:45.328757 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b57f68ee-6261-43ea-ad63-b25d5d4bab54 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1598 microversion: 2.20 time: 0.176110 Jan 19 13:05:45.328757 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 130/261] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:05:45 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1598 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:05:45.350886 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0f5261ec-9cde-4f0d-ae3a-34be407ba33c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:45.351465 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0f5261ec-9cde-4f0d-ae3a-34be407ba33c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:45.358453 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0f5261ec-9cde-4f0d-ae3a-34be407ba33c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:45.358896 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0f5261ec-9cde-4f0d-ae3a-34be407ba33c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:45.359675 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0f5261ec-9cde-4f0d-ae3a-34be407ba33c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:45.360141 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0f5261ec-9cde-4f0d-ae3a-34be407ba33c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:45.450734 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4cbe3050-19ff-49a3-8c50-48f749e6b8e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:45.451337 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4cbe3050-19ff-49a3-8c50-48f749e6b8e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:45.452983 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0f5261ec-9cde-4f0d-ae3a-34be407ba33c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108211 Jan 19 13:05:45.460118 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 132/262] 10.222.0.48 () {60 vars in 1315 bytes} [Wed Jan 19 13:05:45 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:05:45.460841 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4cbe3050-19ff-49a3-8c50-48f749e6b8e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:45.460841 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4cbe3050-19ff-49a3-8c50-48f749e6b8e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:45.461259 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4cbe3050-19ff-49a3-8c50-48f749e6b8e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:45.461541 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4cbe3050-19ff-49a3-8c50-48f749e6b8e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:45.985982 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4cbe3050-19ff-49a3-8c50-48f749e6b8e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:45.993598 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4cbe3050-19ff-49a3-8c50-48f749e6b8e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.546549 Jan 19 13:05:45.994493 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 131/263] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:45 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:46.269282 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-615f5567-ffca-4a12-b092-ce0cfd8c1f80 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:46.270801 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-615f5567-ffca-4a12-b092-ce0cfd8c1f80 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:46.276574 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-615f5567-ffca-4a12-b092-ce0cfd8c1f80 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:46.277025 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-615f5567-ffca-4a12-b092-ce0cfd8c1f80 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:46.277801 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-615f5567-ffca-4a12-b092-ce0cfd8c1f80 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:46.278239 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-615f5567-ffca-4a12-b092-ce0cfd8c1f80 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:46.848588 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4f03f7f5-f51f-4a0c-b11a-ea32781cb33d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:46.849409 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4f03f7f5-f51f-4a0c-b11a-ea32781cb33d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:46.855671 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4f03f7f5-f51f-4a0c-b11a-ea32781cb33d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:46.856245 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4f03f7f5-f51f-4a0c-b11a-ea32781cb33d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:46.857093 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4f03f7f5-f51f-4a0c-b11a-ea32781cb33d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:46.857603 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4f03f7f5-f51f-4a0c-b11a-ea32781cb33d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:49.437211 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-615f5567-ffca-4a12-b092-ce0cfd8c1f80 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 14 microversion: 2.1 time: 3.171815 Jan 19 13:05:49.438543 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 133/264] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:05:46 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 14 bytes in 3174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:05:49.443929 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-0a0e3638-6503-47e9-91d4-037bda450874 req-39a4586f-964c-41f7-a2fb-7ebd5dd3f4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2fc94f-e55f-4947-9824-ffc6edf35e0c", "tag": "7e0a83a8-36d8-4d5c-baf5-d9396dafdb38"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:49.445715 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:05:49.445715 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:05:49.453459 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4f03f7f5-f51f-4a0c-b11a-ea32781cb33d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 14 microversion: 2.20 time: 2.608342 Jan 19 13:05:49.453953 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 132/265] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:05:46 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 14 bytes in 2610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:49.455139 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-0a0e3638-6503-47e9-91d4-037bda450874 req-39a4586f-964c-41f7-a2fb-7ebd5dd3f4c4 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:49.455786 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-0a0e3638-6503-47e9-91d4-037bda450874 req-39a4586f-964c-41f7-a2fb-7ebd5dd3f4c4 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:49.459026 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4fd7e145-5961-47dd-90dd-0c342c0d6723 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:49.459751 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4fd7e145-5961-47dd-90dd-0c342c0d6723 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:49.467791 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-0a0e3638-6503-47e9-91d4-037bda450874 req-39a4586f-964c-41f7-a2fb-7ebd5dd3f4c4 service nova] Creating event network-changed:7e0a83a8-36d8-4d5c-baf5-d9396dafdb38 for instance 0a2fc94f-e55f-4947-9824-ffc6edf35e0c on hv-cinder-82301 Jan 19 13:05:49.469314 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4fd7e145-5961-47dd-90dd-0c342c0d6723 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:49.469764 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4fd7e145-5961-47dd-90dd-0c342c0d6723 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:49.470541 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4fd7e145-5961-47dd-90dd-0c342c0d6723 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:49.470975 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4fd7e145-5961-47dd-90dd-0c342c0d6723 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:49.473457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-0a0e3638-6503-47e9-91d4-037bda450874 req-39a4586f-964c-41f7-a2fb-7ebd5dd3f4c4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033175 Jan 19 13:05:49.474211 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 134/266] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:05:49.687954 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4fd7e145-5961-47dd-90dd-0c342c0d6723 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:49.695504 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4fd7e145-5961-47dd-90dd-0c342c0d6723 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.240580 Jan 19 13:05:49.696178 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 133/267] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:49 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:50.449459 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-960ec82a-dec8-4d42-b00f-3cadc1d3408d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:50.450450 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-960ec82a-dec8-4d42-b00f-3cadc1d3408d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:50.456534 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-960ec82a-dec8-4d42-b00f-3cadc1d3408d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:50.457677 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-960ec82a-dec8-4d42-b00f-3cadc1d3408d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:50.458669 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-960ec82a-dec8-4d42-b00f-3cadc1d3408d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:50.459160 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-960ec82a-dec8-4d42-b00f-3cadc1d3408d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:50.466479 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5901390f-c6b9-478a-8efc-b0bb22a81f8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:50.467626 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5901390f-c6b9-478a-8efc-b0bb22a81f8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:50.475650 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5901390f-c6b9-478a-8efc-b0bb22a81f8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:50.476206 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5901390f-c6b9-478a-8efc-b0bb22a81f8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:50.477061 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5901390f-c6b9-478a-8efc-b0bb22a81f8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:50.477565 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5901390f-c6b9-478a-8efc-b0bb22a81f8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:50.539142 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-960ec82a-dec8-4d42-b00f-3cadc1d3408d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 14 microversion: 2.1 time: 0.093828 Jan 19 13:05:50.539698 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 135/268] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:05:50 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:05:50.542407 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5901390f-c6b9-478a-8efc-b0bb22a81f8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 14 microversion: 2.20 time: 0.081377 Jan 19 13:05:50.543019 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 134/269] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:05:50 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:50.715087 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9a676d9d-7bee-4eef-a4ea-f0c4277a3db1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:50.715087 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9a676d9d-7bee-4eef-a4ea-f0c4277a3db1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:50.720337 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9a676d9d-7bee-4eef-a4ea-f0c4277a3db1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:50.720918 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9a676d9d-7bee-4eef-a4ea-f0c4277a3db1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:50.721726 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9a676d9d-7bee-4eef-a4ea-f0c4277a3db1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:50.722158 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9a676d9d-7bee-4eef-a4ea-f0c4277a3db1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:50.874763 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-9a676d9d-7bee-4eef-a4ea-f0c4277a3db1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:50.883327 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9a676d9d-7bee-4eef-a4ea-f0c4277a3db1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.175058 Jan 19 13:05:50.883947 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 136/270] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:50 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:51.554448 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-914b7ef6-fd3d-4dbf-bd95-e09addf271da tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:51.556711 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f5c8568b-0d45-40e2-bc0e-02e0e83391d0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:51.557634 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f5c8568b-0d45-40e2-bc0e-02e0e83391d0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:51.559442 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-914b7ef6-fd3d-4dbf-bd95-e09addf271da tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:51.567130 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f5c8568b-0d45-40e2-bc0e-02e0e83391d0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:51.567589 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f5c8568b-0d45-40e2-bc0e-02e0e83391d0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:51.568605 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f5c8568b-0d45-40e2-bc0e-02e0e83391d0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:51.569371 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f5c8568b-0d45-40e2-bc0e-02e0e83391d0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:51.573483 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-914b7ef6-fd3d-4dbf-bd95-e09addf271da tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:51.575306 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-914b7ef6-fd3d-4dbf-bd95-e09addf271da tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:51.576224 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-914b7ef6-fd3d-4dbf-bd95-e09addf271da tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:51.576664 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-914b7ef6-fd3d-4dbf-bd95-e09addf271da tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:51.645362 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f5c8568b-0d45-40e2-bc0e-02e0e83391d0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 14 microversion: 2.20 time: 0.095305 Jan 19 13:05:51.646137 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 137/271] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:05:51 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:51.663320 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-914b7ef6-fd3d-4dbf-bd95-e09addf271da tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 14 microversion: 2.1 time: 0.116870 Jan 19 13:05:51.664324 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 135/272] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:05:51 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:05:51.912439 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-516507f3-ee85-47f8-aff1-3d86fa1f2aae tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:51.914198 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-516507f3-ee85-47f8-aff1-3d86fa1f2aae tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:51.921354 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-516507f3-ee85-47f8-aff1-3d86fa1f2aae tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:51.921804 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-516507f3-ee85-47f8-aff1-3d86fa1f2aae tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:51.922606 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-516507f3-ee85-47f8-aff1-3d86fa1f2aae tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:51.923038 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-516507f3-ee85-47f8-aff1-3d86fa1f2aae tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:52.073575 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-516507f3-ee85-47f8-aff1-3d86fa1f2aae tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:52.081434 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-516507f3-ee85-47f8-aff1-3d86fa1f2aae tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.183589 Jan 19 13:05:52.082759 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 138/273] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:51 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:52.658277 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ea44f0d9-cb82-485e-9020-07da5cb6df6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:52.659355 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ea44f0d9-cb82-485e-9020-07da5cb6df6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:52.668675 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ea44f0d9-cb82-485e-9020-07da5cb6df6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:52.669431 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ea44f0d9-cb82-485e-9020-07da5cb6df6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:52.670908 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ea44f0d9-cb82-485e-9020-07da5cb6df6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:52.671374 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ea44f0d9-cb82-485e-9020-07da5cb6df6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:52.675105 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7130920b-7543-4d83-a7b5-506c5d8cbe4f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:52.684046 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7130920b-7543-4d83-a7b5-506c5d8cbe4f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:52.693401 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7130920b-7543-4d83-a7b5-506c5d8cbe4f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:52.694963 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7130920b-7543-4d83-a7b5-506c5d8cbe4f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:52.696064 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7130920b-7543-4d83-a7b5-506c5d8cbe4f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:52.696657 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7130920b-7543-4d83-a7b5-506c5d8cbe4f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:52.759268 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ea44f0d9-cb82-485e-9020-07da5cb6df6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 14 microversion: 2.20 time: 0.105570 Jan 19 13:05:52.760306 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 136/274] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:05:52 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:52.780212 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7130920b-7543-4d83-a7b5-506c5d8cbe4f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 14 microversion: 2.1 time: 0.109192 Jan 19 13:05:52.780813 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 139/275] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:05:52 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 13:05:53.101061 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-8a296b7d-77a4-4b7b-9bb5-bd00a9de30e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:53.101995 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-8a296b7d-77a4-4b7b-9bb5-bd00a9de30e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:53.109173 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8a296b7d-77a4-4b7b-9bb5-bd00a9de30e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:53.109951 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8a296b7d-77a4-4b7b-9bb5-bd00a9de30e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:53.111024 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8a296b7d-77a4-4b7b-9bb5-bd00a9de30e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:53.111558 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8a296b7d-77a4-4b7b-9bb5-bd00a9de30e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:53.261729 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-8a296b7d-77a4-4b7b-9bb5-bd00a9de30e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:53.270270 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-8a296b7d-77a4-4b7b-9bb5-bd00a9de30e0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.173575 Jan 19 13:05:53.270841 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 137/276] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:53 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:53.772827 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7d8ba700-848c-44d9-83d8-08988753748e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:53.773827 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7d8ba700-848c-44d9-83d8-08988753748e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:53.781034 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d8ba700-848c-44d9-83d8-08988753748e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:53.781477 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d8ba700-848c-44d9-83d8-08988753748e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:53.782255 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d8ba700-848c-44d9-83d8-08988753748e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:53.782687 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d8ba700-848c-44d9-83d8-08988753748e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:53.791787 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9c1eb8d2-a505-4a3c-9be5-5edf6b7b8ad2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:53.794120 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9c1eb8d2-a505-4a3c-9be5-5edf6b7b8ad2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:53.802631 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9c1eb8d2-a505-4a3c-9be5-5edf6b7b8ad2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:53.803354 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9c1eb8d2-a505-4a3c-9be5-5edf6b7b8ad2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:53.804413 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9c1eb8d2-a505-4a3c-9be5-5edf6b7b8ad2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:53.805072 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9c1eb8d2-a505-4a3c-9be5-5edf6b7b8ad2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:53.871670 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7d8ba700-848c-44d9-83d8-08988753748e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 14 microversion: 2.20 time: 0.103634 Jan 19 13:05:53.872683 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 140/277] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:05:53 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:53.877079 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9c1eb8d2-a505-4a3c-9be5-5edf6b7b8ad2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 14 microversion: 2.1 time: 0.089423 Jan 19 13:05:53.877953 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 138/278] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:05:53 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 13:05:54.287296 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-cadf55a6-bc0a-4f5b-a4d5-582d632d4cfe tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:54.288265 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-cadf55a6-bc0a-4f5b-a4d5-582d632d4cfe tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:54.297310 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cadf55a6-bc0a-4f5b-a4d5-582d632d4cfe tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:54.297766 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cadf55a6-bc0a-4f5b-a4d5-582d632d4cfe tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:54.298579 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cadf55a6-bc0a-4f5b-a4d5-582d632d4cfe tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:54.298988 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cadf55a6-bc0a-4f5b-a4d5-582d632d4cfe tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:54.472507 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-cadf55a6-bc0a-4f5b-a4d5-582d632d4cfe tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:54.480504 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-cadf55a6-bc0a-4f5b-a4d5-582d632d4cfe tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.197413 Jan 19 13:05:54.482389 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 141/279] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:54 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:54.887931 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-83687cac-d9d1-4611-8d14-c5060a1f0e92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:54.888768 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3b4fb147-6e9f-4e70-8bcd-d9e76c719294 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:54.889128 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-83687cac-d9d1-4611-8d14-c5060a1f0e92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:54.889757 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3b4fb147-6e9f-4e70-8bcd-d9e76c719294 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:54.896768 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-83687cac-d9d1-4611-8d14-c5060a1f0e92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:54.897519 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-83687cac-d9d1-4611-8d14-c5060a1f0e92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:54.897649 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b4fb147-6e9f-4e70-8bcd-d9e76c719294 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:54.898149 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b4fb147-6e9f-4e70-8bcd-d9e76c719294 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:54.898387 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-83687cac-d9d1-4611-8d14-c5060a1f0e92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:54.898860 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-83687cac-d9d1-4611-8d14-c5060a1f0e92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:54.899082 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b4fb147-6e9f-4e70-8bcd-d9e76c719294 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:54.899732 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b4fb147-6e9f-4e70-8bcd-d9e76c719294 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:55.202253 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3b4fb147-6e9f-4e70-8bcd-d9e76c719294 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 3675 microversion: 2.1 time: 0.317304 Jan 19 13:05:55.202933 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 142/280] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:05:54 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 3675 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:05:55.208764 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-83687cac-d9d1-4611-8d14-c5060a1f0e92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 14 microversion: 2.20 time: 0.325846 Jan 19 13:05:55.209445 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 139/281] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:05:54 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 14 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:55.499704 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a2559a86-beb5-46d3-ba99-826d760c80d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:55.500629 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a2559a86-beb5-46d3-ba99-826d760c80d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:55.508923 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a2559a86-beb5-46d3-ba99-826d760c80d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:55.509778 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a2559a86-beb5-46d3-ba99-826d760c80d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:55.510786 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a2559a86-beb5-46d3-ba99-826d760c80d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:55.511454 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a2559a86-beb5-46d3-ba99-826d760c80d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:55.677195 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-a2559a86-beb5-46d3-ba99-826d760c80d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:55.685056 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a2559a86-beb5-46d3-ba99-826d760c80d2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.189456 Jan 19 13:05:55.686160 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 143/282] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:55 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:56.217027 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-afa26951-8469-4dda-8aa9-f93bff406f74 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:56.218693 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-afa26951-8469-4dda-8aa9-f93bff406f74 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:56.219649 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6e37bf2a-6676-4b78-9cf0-b63de4200ebd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:56.220664 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6e37bf2a-6676-4b78-9cf0-b63de4200ebd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:56.228736 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6e37bf2a-6676-4b78-9cf0-b63de4200ebd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:56.229190 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6e37bf2a-6676-4b78-9cf0-b63de4200ebd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:56.229394 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-afa26951-8469-4dda-8aa9-f93bff406f74 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:56.229983 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6e37bf2a-6676-4b78-9cf0-b63de4200ebd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:56.230108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-afa26951-8469-4dda-8aa9-f93bff406f74 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:56.230422 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6e37bf2a-6676-4b78-9cf0-b63de4200ebd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:56.231073 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-afa26951-8469-4dda-8aa9-f93bff406f74 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:56.231747 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-afa26951-8469-4dda-8aa9-f93bff406f74 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:58.781704 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6e37bf2a-6676-4b78-9cf0-b63de4200ebd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 12882 microversion: 2.20 time: 2.565596 Jan 19 13:05:58.782355 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 144/283] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:05:56 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 12882 bytes in 2567 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:05:58.787297 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d008377e-006c-4a69-8388-44c0edaee3dc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:58.788006 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d008377e-006c-4a69-8388-44c0edaee3dc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:58.794768 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d008377e-006c-4a69-8388-44c0edaee3dc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:58.795218 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d008377e-006c-4a69-8388-44c0edaee3dc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:58.796005 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d008377e-006c-4a69-8388-44c0edaee3dc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:58.796454 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d008377e-006c-4a69-8388-44c0edaee3dc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:58.926951 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d008377e-006c-4a69-8388-44c0edaee3dc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:05:58.934662 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d008377e-006c-4a69-8388-44c0edaee3dc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.151211 Jan 19 13:05:58.935232 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 145/284] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:58 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:05:59.060515 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-afa26951-8469-4dda-8aa9-f93bff406f74 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 15064 microversion: 2.1 time: 2.850237 Jan 19 13:05:59.061164 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 140/285] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:05:56 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 15064 bytes in 2852 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:05:59.793845 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f9d4d992-fb57-4271-9736-ded3637c6526 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:05:59.794785 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f9d4d992-fb57-4271-9736-ded3637c6526 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:59.802009 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f9d4d992-fb57-4271-9736-ded3637c6526 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:59.802451 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f9d4d992-fb57-4271-9736-ded3637c6526 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:59.803222 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f9d4d992-fb57-4271-9736-ded3637c6526 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:59.803650 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f9d4d992-fb57-4271-9736-ded3637c6526 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:59.906641 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f9d4d992-fb57-4271-9736-ded3637c6526 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 16319 microversion: 2.20 time: 0.116781 Jan 19 13:05:59.907445 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 146/286] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:05:59 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 16319 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:05:59.959017 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0e1b150a-c016-4a84-ad1b-c4bd5876ec70 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:05:59.959716 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0e1b150a-c016-4a84-ad1b-c4bd5876ec70 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:05:59.966951 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0e1b150a-c016-4a84-ad1b-c4bd5876ec70 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:59.967398 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0e1b150a-c016-4a84-ad1b-c4bd5876ec70 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:05:59.968210 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0e1b150a-c016-4a84-ad1b-c4bd5876ec70 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:05:59.968647 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0e1b150a-c016-4a84-ad1b-c4bd5876ec70 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:00.074540 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8c3756c7-f970-4524-9a25-0ebe4e870965 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:00.076154 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8c3756c7-f970-4524-9a25-0ebe4e870965 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:00.085049 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c3756c7-f970-4524-9a25-0ebe4e870965 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:00.085610 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c3756c7-f970-4524-9a25-0ebe4e870965 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:00.086603 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c3756c7-f970-4524-9a25-0ebe4e870965 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:00.086962 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c3756c7-f970-4524-9a25-0ebe4e870965 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:00.107117 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0e1b150a-c016-4a84-ad1b-c4bd5876ec70 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:00.115460 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0e1b150a-c016-4a84-ad1b-c4bd5876ec70 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.166924 Jan 19 13:06:00.116410 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 141/287] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:05:59 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:00.181818 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8c3756c7-f970-4524-9a25-0ebe4e870965 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 17960 microversion: 2.1 time: 0.111610 Jan 19 13:06:00.184007 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 147/288] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:00 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 17960 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:00.829070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1676267706", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452", "networks": [{"uuid": "fb2a0380-a969-49ba-a38e-e2e05cea65f5"}]}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:00.883657 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.network.neutron [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] validate_networks() for [('fb2a0380-a969-49ba-a38e-e2e05cea65f5', None, None, None, None, None)] {{(pid=116360) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:06:00.923030 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-85a76c75-1527-4c79-89b1-7fe92ae3307f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:00.924078 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-85a76c75-1527-4c79-89b1-7fe92ae3307f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:00.935305 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-85a76c75-1527-4c79-89b1-7fe92ae3307f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:00.935779 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-85a76c75-1527-4c79-89b1-7fe92ae3307f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:00.936686 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-85a76c75-1527-4c79-89b1-7fe92ae3307f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:00.937295 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-85a76c75-1527-4c79-89b1-7fe92ae3307f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:01.032883 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-85a76c75-1527-4c79-89b1-7fe92ae3307f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 17960 microversion: 2.20 time: 0.117830 Jan 19 13:06:01.034433 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 148/289] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:00 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 17960 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:06:01.136239 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2b40837d-00b2-4bb9-89c7-2ed841c33814 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:01.137602 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2b40837d-00b2-4bb9-89c7-2ed841c33814 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:01.150920 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2b40837d-00b2-4bb9-89c7-2ed841c33814 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:01.151596 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2b40837d-00b2-4bb9-89c7-2ed841c33814 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:01.152865 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2b40837d-00b2-4bb9-89c7-2ed841c33814 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:01.154155 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2b40837d-00b2-4bb9-89c7-2ed841c33814 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:01.362184 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Flavor limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:06:01.363788 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Image limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:06:01.365059 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Flavor pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:06:01.365354 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Image pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:06:01.365748 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:06:01.376161 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:01.376873 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:01.378126 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:01.378772 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:01.400539 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Getting quotas for project 167b7b3080be4152a08560f830129a97. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:06:01.407190 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Getting quotas for user 3cfb3a4a011445c493c301c51f7332ac and project 167b7b3080be4152a08560f830129a97. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:06:01.409314 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2b40837d-00b2-4bb9-89c7-2ed841c33814 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:01.420542 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2b40837d-00b2-4bb9-89c7-2ed841c33814 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.289791 Jan 19 13:06:01.421386 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 149/290] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:01 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:01.431090 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-cc8bf495-7a8c-4f1c-9d99-c5e645f011fd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:01.432971 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-cc8bf495-7a8c-4f1c-9d99-c5e645f011fd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:01.433112 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Going to run 1 instances... {{(pid=116360) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:06:01.435530 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:06:01.442264 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cc8bf495-7a8c-4f1c-9d99-c5e645f011fd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:01.442826 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cc8bf495-7a8c-4f1c-9d99-c5e645f011fd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:01.443714 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cc8bf495-7a8c-4f1c-9d99-c5e645f011fd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:01.444409 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cc8bf495-7a8c-4f1c-9d99-c5e645f011fd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:01.494672 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-41a98c10-044e-494b-a13f-bf75b8a0e15a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670843 Jan 19 13:06:01.495316 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 142/291] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:06:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:06:01.505952 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-1ed99815-1a76-4629-a1c4-8ee6f8279fae tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:01.506348 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-1ed99815-1a76-4629-a1c4-8ee6f8279fae tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:01.532820 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-cc8bf495-7a8c-4f1c-9d99-c5e645f011fd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 19342 microversion: 2.1 time: 0.108379 Jan 19 13:06:01.541629 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 150/292] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:01 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 19342 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:01.560394 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-1ed99815-1a76-4629-a1c4-8ee6f8279fae tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:01.567735 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-1ed99815-1a76-4629-a1c4-8ee6f8279fae tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 200 len: 1214 microversion: 2.1 time: 0.066199 Jan 19 13:06:01.568334 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 143/293] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:01 2022] GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:06:02.049452 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7d11f9b9-acb2-48b6-8198-74115f3a446d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:02.051525 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7d11f9b9-acb2-48b6-8198-74115f3a446d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:02.059229 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d11f9b9-acb2-48b6-8198-74115f3a446d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:02.059846 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d11f9b9-acb2-48b6-8198-74115f3a446d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:02.060985 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d11f9b9-acb2-48b6-8198-74115f3a446d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:02.061577 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d11f9b9-acb2-48b6-8198-74115f3a446d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:02.156146 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7d11f9b9-acb2-48b6-8198-74115f3a446d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 19342 microversion: 2.20 time: 0.113873 Jan 19 13:06:02.157044 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 151/294] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:02 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 19342 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:02.438528 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d7ccb0ee-c8f7-471a-898d-f841be8bf2ad tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:02.439138 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d7ccb0ee-c8f7-471a-898d-f841be8bf2ad tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:02.446315 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d7ccb0ee-c8f7-471a-898d-f841be8bf2ad tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:02.446990 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d7ccb0ee-c8f7-471a-898d-f841be8bf2ad tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:02.447784 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d7ccb0ee-c8f7-471a-898d-f841be8bf2ad tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:02.448252 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d7ccb0ee-c8f7-471a-898d-f841be8bf2ad tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:02.554963 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f431071d-a6de-4654-b9b9-175737b9ed97 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:02.556011 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f431071d-a6de-4654-b9b9-175737b9ed97 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:02.578702 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f431071d-a6de-4654-b9b9-175737b9ed97 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:02.582897 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f431071d-a6de-4654-b9b9-175737b9ed97 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:02.587420 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f431071d-a6de-4654-b9b9-175737b9ed97 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:02.587871 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f431071d-a6de-4654-b9b9-175737b9ed97 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:02.632587 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d7ccb0ee-c8f7-471a-898d-f841be8bf2ad tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:02.642032 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d7ccb0ee-c8f7-471a-898d-f841be8bf2ad tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.205890 Jan 19 13:06:02.642779 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 144/295] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:02 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:02.648103 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-8b7a183a-ed35-486a-8cf1-5618ecb78fb6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:02.648751 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-8b7a183a-ed35-486a-8cf1-5618ecb78fb6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:02.654600 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8b7a183a-ed35-486a-8cf1-5618ecb78fb6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:02.655223 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8b7a183a-ed35-486a-8cf1-5618ecb78fb6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:02.656223 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8b7a183a-ed35-486a-8cf1-5618ecb78fb6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:02.656797 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8b7a183a-ed35-486a-8cf1-5618ecb78fb6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:02.686269 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-8b7a183a-ed35-486a-8cf1-5618ecb78fb6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Going to try to terminate instance {{(pid=116360) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:06:02.691704 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f431071d-a6de-4654-b9b9-175737b9ed97 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 21233 microversion: 2.1 time: 0.143369 Jan 19 13:06:02.692779 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 152/296] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:02 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 21233 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:02.701062 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c7fb4bcb-4ee6-4d0e-8139-c451f0be5566 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:02.701980 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c7fb4bcb-4ee6-4d0e-8139-c451f0be5566 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:02.711068 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c7fb4bcb-4ee6-4d0e-8139-c451f0be5566 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:02.711952 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c7fb4bcb-4ee6-4d0e-8139-c451f0be5566 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:02.713416 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c7fb4bcb-4ee6-4d0e-8139-c451f0be5566 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:02.714149 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c7fb4bcb-4ee6-4d0e-8139-c451f0be5566 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:02.819724 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-8b7a183a-ed35-486a-8cf1-5618ecb78fb6 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 204 len: 0 microversion: 2.1 time: 0.175421 Jan 19 13:06:02.820655 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 145/297] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:06:02 2022] DELETE /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:06:02.833376 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ab64716e-4449-4901-95a9-f4d89297d17d tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:02.834169 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ab64716e-4449-4901-95a9-f4d89297d17d tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:02.837319 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-c7fb4bcb-4ee6-4d0e-8139-c451f0be5566 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:02.841728 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab64716e-4449-4901-95a9-f4d89297d17d tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:02.842286 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab64716e-4449-4901-95a9-f4d89297d17d tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:02.844361 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab64716e-4449-4901-95a9-f4d89297d17d tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:02.844877 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab64716e-4449-4901-95a9-f4d89297d17d tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:02.845345 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c7fb4bcb-4ee6-4d0e-8139-c451f0be5566 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 200 len: 1274 microversion: 2.1 time: 0.150777 Jan 19 13:06:02.845904 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 153/298] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:02 2022] GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 1274 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:03.109834 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ab64716e-4449-4901-95a9-f4d89297d17d tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:03.123083 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ab64716e-4449-4901-95a9-f4d89297d17d tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1554 microversion: 2.1 time: 0.296965 Jan 19 13:06:03.124371 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 146/299] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:02 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1554 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:03.167636 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4c0a86fe-0f02-49dc-b9b8-720e199c5532 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:03.169357 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4c0a86fe-0f02-49dc-b9b8-720e199c5532 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:03.176701 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4c0a86fe-0f02-49dc-b9b8-720e199c5532 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:03.177425 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4c0a86fe-0f02-49dc-b9b8-720e199c5532 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:03.178558 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4c0a86fe-0f02-49dc-b9b8-720e199c5532 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:03.179224 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4c0a86fe-0f02-49dc-b9b8-720e199c5532 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:03.269589 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4c0a86fe-0f02-49dc-b9b8-720e199c5532 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 20985 microversion: 2.20 time: 0.105615 Jan 19 13:06:03.273264 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 154/300] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:03 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 20985 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:06:03.658414 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-587422b0-8637-430b-85aa-5d3a0fd82af7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:03.659027 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-587422b0-8637-430b-85aa-5d3a0fd82af7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:03.668159 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-587422b0-8637-430b-85aa-5d3a0fd82af7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:03.668815 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-587422b0-8637-430b-85aa-5d3a0fd82af7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:03.669956 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-587422b0-8637-430b-85aa-5d3a0fd82af7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:03.670577 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-587422b0-8637-430b-85aa-5d3a0fd82af7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:03.704791 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5ee6aacb-014a-4df0-b272-d966b5f86a8f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:03.706000 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5ee6aacb-014a-4df0-b272-d966b5f86a8f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:03.720776 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5ee6aacb-014a-4df0-b272-d966b5f86a8f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:03.721651 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5ee6aacb-014a-4df0-b272-d966b5f86a8f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:03.722036 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5ee6aacb-014a-4df0-b272-d966b5f86a8f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:03.723020 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5ee6aacb-014a-4df0-b272-d966b5f86a8f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:03.849320 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5ee6aacb-014a-4df0-b272-d966b5f86a8f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 22446 microversion: 2.1 time: 0.148975 Jan 19 13:06:03.850777 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 155/301] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:03 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 22446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:03.869781 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2f4729bf-d32e-4df0-a718-33e8d35dd2cd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:03.876483 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2f4729bf-d32e-4df0-a718-33e8d35dd2cd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:03.886635 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2f4729bf-d32e-4df0-a718-33e8d35dd2cd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:03.887569 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2f4729bf-d32e-4df0-a718-33e8d35dd2cd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:03.888535 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2f4729bf-d32e-4df0-a718-33e8d35dd2cd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:03.889011 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2f4729bf-d32e-4df0-a718-33e8d35dd2cd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:04.013255 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-587422b0-8637-430b-85aa-5d3a0fd82af7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:04.022998 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-587422b0-8637-430b-85aa-5d3a0fd82af7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.368247 Jan 19 13:06:04.023784 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 147/302] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:03 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:04.141588 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ebdf0ced-ca49-4e4e-9b85-3550e363d760 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:04.142413 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ebdf0ced-ca49-4e4e-9b85-3550e363d760 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:04.149946 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ebdf0ced-ca49-4e4e-9b85-3550e363d760 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:04.150642 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ebdf0ced-ca49-4e4e-9b85-3550e363d760 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:04.152019 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ebdf0ced-ca49-4e4e-9b85-3550e363d760 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:04.152633 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ebdf0ced-ca49-4e4e-9b85-3550e363d760 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:04.169800 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2f4729bf-d32e-4df0-a718-33e8d35dd2cd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:04.180080 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2f4729bf-d32e-4df0-a718-33e8d35dd2cd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 200 len: 1314 microversion: 2.1 time: 0.320876 Jan 19 13:06:04.180654 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 156/303] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:03 2022] GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:06:04.280175 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c8656893-23b1-44a6-b46b-789ffd800f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:04.281180 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c8656893-23b1-44a6-b46b-789ffd800f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:04.288381 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c8656893-23b1-44a6-b46b-789ffd800f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:04.289153 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c8656893-23b1-44a6-b46b-789ffd800f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:04.290116 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c8656893-23b1-44a6-b46b-789ffd800f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:04.290710 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c8656893-23b1-44a6-b46b-789ffd800f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:04.408709 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c8656893-23b1-44a6-b46b-789ffd800f39 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 22156 microversion: 2.20 time: 0.132056 Jan 19 13:06:04.412850 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 157/304] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:04 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 22156 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:06:04.427428 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ebdf0ced-ca49-4e4e-9b85-3550e363d760 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:04.436725 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ebdf0ced-ca49-4e4e-9b85-3550e363d760 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1554 microversion: 2.1 time: 0.299284 Jan 19 13:06:04.438476 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 148/305] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:04 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1554 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:04.613146 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-f0cf15d7-3650-4bc3-bae0-af39d3239b1c req-2aff271e-bbcf-4e78-87af-a78806d2aaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc6ff9a-b69e-4da7-b919-cfb76d90895c", "tag": "aaef8b17-3d61-4230-bf03-76181085c780"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:04.614745 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:06:04.614745 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:06:04.623324 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-f0cf15d7-3650-4bc3-bae0-af39d3239b1c req-2aff271e-bbcf-4e78-87af-a78806d2aaf7 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:04.624216 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-f0cf15d7-3650-4bc3-bae0-af39d3239b1c req-2aff271e-bbcf-4e78-87af-a78806d2aaf7 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:04.639273 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-f0cf15d7-3650-4bc3-bae0-af39d3239b1c req-2aff271e-bbcf-4e78-87af-a78806d2aaf7 service nova] Creating event network-changed:aaef8b17-3d61-4230-bf03-76181085c780 for instance 8cc6ff9a-b69e-4da7-b919-cfb76d90895c on hv-cinder-82301 Jan 19 13:06:04.647619 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-f0cf15d7-3650-4bc3-bae0-af39d3239b1c req-2aff271e-bbcf-4e78-87af-a78806d2aaf7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038863 Jan 19 13:06:04.649326 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 158/306] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:06:04.862001 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-41e78d4c-3f5e-4e7e-8d50-b67dbd8a0167 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:04.865297 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-41e78d4c-3f5e-4e7e-8d50-b67dbd8a0167 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:04.872157 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-41e78d4c-3f5e-4e7e-8d50-b67dbd8a0167 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:04.872883 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-41e78d4c-3f5e-4e7e-8d50-b67dbd8a0167 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:04.874135 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-41e78d4c-3f5e-4e7e-8d50-b67dbd8a0167 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:04.874875 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-41e78d4c-3f5e-4e7e-8d50-b67dbd8a0167 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:05.001146 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-41e78d4c-3f5e-4e7e-8d50-b67dbd8a0167 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 23241 microversion: 2.1 time: 0.142966 Jan 19 13:06:05.007827 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 149/307] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:04 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 23241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:05.041798 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3248bc1f-e752-4a79-8b86-0b2c40bfb380 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:05.042440 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3248bc1f-e752-4a79-8b86-0b2c40bfb380 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:05.049984 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3248bc1f-e752-4a79-8b86-0b2c40bfb380 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:05.051209 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3248bc1f-e752-4a79-8b86-0b2c40bfb380 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:05.052736 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3248bc1f-e752-4a79-8b86-0b2c40bfb380 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:05.053172 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3248bc1f-e752-4a79-8b86-0b2c40bfb380 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:05.198611 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-bb9271cf-f92f-49b6-ad23-402ca1eeb6e7 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:05.199405 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-bb9271cf-f92f-49b6-ad23-402ca1eeb6e7 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:05.209101 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bb9271cf-f92f-49b6-ad23-402ca1eeb6e7 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:05.209765 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bb9271cf-f92f-49b6-ad23-402ca1eeb6e7 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:05.211563 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bb9271cf-f92f-49b6-ad23-402ca1eeb6e7 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:05.212757 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bb9271cf-f92f-49b6-ad23-402ca1eeb6e7 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:05.255617 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3248bc1f-e752-4a79-8b86-0b2c40bfb380 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:05.264431 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3248bc1f-e752-4a79-8b86-0b2c40bfb380 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.227019 Jan 19 13:06:05.265008 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 159/308] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:05 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:05.422552 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f3acca5e-c987-46a0-815a-6bb8b341f368 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:05.424504 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f3acca5e-c987-46a0-815a-6bb8b341f368 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:05.433439 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f3acca5e-c987-46a0-815a-6bb8b341f368 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:05.434071 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f3acca5e-c987-46a0-815a-6bb8b341f368 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:05.435040 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f3acca5e-c987-46a0-815a-6bb8b341f368 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:05.435667 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f3acca5e-c987-46a0-815a-6bb8b341f368 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:05.577587 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f3acca5e-c987-46a0-815a-6bb8b341f368 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 23032 microversion: 2.20 time: 0.158510 Jan 19 13:06:05.578244 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 160/309] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:05 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 23032 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:06:05.585734 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0b4a0b99-ce7a-4ab0-91ec-05459d5fd0bb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:05.586437 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0b4a0b99-ce7a-4ab0-91ec-05459d5fd0bb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:05.593803 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0b4a0b99-ce7a-4ab0-91ec-05459d5fd0bb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:05.594258 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0b4a0b99-ce7a-4ab0-91ec-05459d5fd0bb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:05.595117 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0b4a0b99-ce7a-4ab0-91ec-05459d5fd0bb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:05.595717 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0b4a0b99-ce7a-4ab0-91ec-05459d5fd0bb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:05.803864 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bb9271cf-f92f-49b6-ad23-402ca1eeb6e7 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:05.814859 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-bb9271cf-f92f-49b6-ad23-402ca1eeb6e7 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 200 len: 1314 microversion: 2.1 time: 0.620423 Jan 19 13:06:05.816931 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 150/310] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:05 2022] GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:06:06.017052 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-bb359910-3a78-494e-906e-362c8b57b7c6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:06.020056 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-bb359910-3a78-494e-906e-362c8b57b7c6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:06.027371 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bb359910-3a78-494e-906e-362c8b57b7c6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:06.028182 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bb359910-3a78-494e-906e-362c8b57b7c6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:06.045249 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bb359910-3a78-494e-906e-362c8b57b7c6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:06.047397 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bb359910-3a78-494e-906e-362c8b57b7c6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:06.107246 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0b4a0b99-ce7a-4ab0-91ec-05459d5fd0bb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:06.127177 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0b4a0b99-ce7a-4ab0-91ec-05459d5fd0bb tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1554 microversion: 2.1 time: 0.546944 Jan 19 13:06:06.128299 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 161/311] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:05 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1554 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:06.166776 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-bb359910-3a78-494e-906e-362c8b57b7c6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 24298 microversion: 2.1 time: 0.155613 Jan 19 13:06:06.167679 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 151/312] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:06 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 24298 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:06.281794 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3158bd80-00df-44b6-b9f3-38aef2488c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:06.282974 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3158bd80-00df-44b6-b9f3-38aef2488c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:06.291497 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3158bd80-00df-44b6-b9f3-38aef2488c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:06.292275 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3158bd80-00df-44b6-b9f3-38aef2488c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:06.293756 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3158bd80-00df-44b6-b9f3-38aef2488c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:06.294275 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3158bd80-00df-44b6-b9f3-38aef2488c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:06.590360 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b9d59b65-e364-45dc-a838-2cf4f61f9b2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:06.591517 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b9d59b65-e364-45dc-a838-2cf4f61f9b2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:06.598793 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b9d59b65-e364-45dc-a838-2cf4f61f9b2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:06.599835 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b9d59b65-e364-45dc-a838-2cf4f61f9b2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:06.612685 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b9d59b65-e364-45dc-a838-2cf4f61f9b2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:06.614075 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b9d59b65-e364-45dc-a838-2cf4f61f9b2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:06.615082 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3158bd80-00df-44b6-b9f3-38aef2488c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:06.625650 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3158bd80-00df-44b6-b9f3-38aef2488c87 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.348007 Jan 19 13:06:06.626535 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 162/313] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:06 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:06.774959 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b9d59b65-e364-45dc-a838-2cf4f61f9b2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 23848 microversion: 2.20 time: 0.189316 Jan 19 13:06:06.775611 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 152/314] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:06 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 23848 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:06.833639 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b4cb7b9c-2d28-4f12-82e5-d0bdc8a40037 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:06.834513 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b4cb7b9c-2d28-4f12-82e5-d0bdc8a40037 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:06.840890 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b4cb7b9c-2d28-4f12-82e5-d0bdc8a40037 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:06.841617 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b4cb7b9c-2d28-4f12-82e5-d0bdc8a40037 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:06.842632 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b4cb7b9c-2d28-4f12-82e5-d0bdc8a40037 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:06.843138 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b4cb7b9c-2d28-4f12-82e5-d0bdc8a40037 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:07.010674 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-44d7fe35-ad2f-4f07-bb33-bebae3033be3 req-9141e625-7ade-4f33-a3b8-7f6a83d95803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa85ce7-f190-47c1-bf94-e1d5d7b98070", "name": "network-vif-deleted", "tag": "c2682348-227e-4a90-8c47-f6e3e523ed6d"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:07.012215 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:06:07.012215 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:06:07.025829 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-44d7fe35-ad2f-4f07-bb33-bebae3033be3 req-9141e625-7ade-4f33-a3b8-7f6a83d95803 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:07.026503 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-44d7fe35-ad2f-4f07-bb33-bebae3033be3 req-9141e625-7ade-4f33-a3b8-7f6a83d95803 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:07.050137 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-44d7fe35-ad2f-4f07-bb33-bebae3033be3 req-9141e625-7ade-4f33-a3b8-7f6a83d95803 service nova] Creating event network-vif-deleted:c2682348-227e-4a90-8c47-f6e3e523ed6d for instance 3fa85ce7-f190-47c1-bf94-e1d5d7b98070 on hv-cinder-82301 Jan 19 13:06:07.062761 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-44d7fe35-ad2f-4f07-bb33-bebae3033be3 req-9141e625-7ade-4f33-a3b8-7f6a83d95803 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055770 Jan 19 13:06:07.074498 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 153/315] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:06:07.123779 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b4cb7b9c-2d28-4f12-82e5-d0bdc8a40037 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:07.132745 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b4cb7b9c-2d28-4f12-82e5-d0bdc8a40037 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 200 len: 1314 microversion: 2.1 time: 0.303229 Jan 19 13:06:07.134146 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 163/316] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:06 2022] GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:07.145337 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-dff8eb0c-eac1-44c4-8953-548af499aa20 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:07.146040 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-dff8eb0c-eac1-44c4-8953-548af499aa20 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:07.153781 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dff8eb0c-eac1-44c4-8953-548af499aa20 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:07.154221 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dff8eb0c-eac1-44c4-8953-548af499aa20 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:07.156515 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dff8eb0c-eac1-44c4-8953-548af499aa20 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:07.157302 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dff8eb0c-eac1-44c4-8953-548af499aa20 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:07.186150 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7b1f54a3-2b3f-4c0f-af64-843416ceb3a4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:07.187963 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7b1f54a3-2b3f-4c0f-af64-843416ceb3a4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:07.210971 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7b1f54a3-2b3f-4c0f-af64-843416ceb3a4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:07.211507 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7b1f54a3-2b3f-4c0f-af64-843416ceb3a4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:07.213334 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7b1f54a3-2b3f-4c0f-af64-843416ceb3a4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:07.214666 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7b1f54a3-2b3f-4c0f-af64-843416ceb3a4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:07.261221 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-dff8eb0c-eac1-44c4-8953-548af499aa20 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f649e26f7b642eea3047edbcdc5f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7f65164ce40a1837e0dac2835a435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:07.278346 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-dff8eb0c-eac1-44c4-8953-548af499aa20 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 200 len: 1346 microversion: 2.1 time: 0.137261 Jan 19 13:06:07.278935 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 154/317] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:07 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 1346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:07.338103 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7b1f54a3-2b3f-4c0f-af64-843416ceb3a4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 24859 microversion: 2.1 time: 0.158906 Jan 19 13:06:07.343186 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 164/318] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:07 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 24859 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:07.646577 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-01ef28d8-2043-4ec8-bef9-18c6de5d7fe9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:07.647663 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-01ef28d8-2043-4ec8-bef9-18c6de5d7fe9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:07.658260 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-01ef28d8-2043-4ec8-bef9-18c6de5d7fe9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:07.659030 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-01ef28d8-2043-4ec8-bef9-18c6de5d7fe9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:07.660905 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-01ef28d8-2043-4ec8-bef9-18c6de5d7fe9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:07.662033 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-01ef28d8-2043-4ec8-bef9-18c6de5d7fe9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:07.789185 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3b110d48-d646-4036-8c8a-660ccfde2776 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:07.790289 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3b110d48-d646-4036-8c8a-660ccfde2776 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:07.800231 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b110d48-d646-4036-8c8a-660ccfde2776 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:07.801516 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b110d48-d646-4036-8c8a-660ccfde2776 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:07.802609 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b110d48-d646-4036-8c8a-660ccfde2776 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:07.802999 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b110d48-d646-4036-8c8a-660ccfde2776 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:07.805694 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-01ef28d8-2043-4ec8-bef9-18c6de5d7fe9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:07.814545 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-01ef28d8-2043-4ec8-bef9-18c6de5d7fe9 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.175109 Jan 19 13:06:07.815110 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 155/319] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:07 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:07.912498 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3b110d48-d646-4036-8c8a-660ccfde2776 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 24759 microversion: 2.20 time: 0.128636 Jan 19 13:06:07.913823 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 165/320] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:07 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 24759 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:08.150656 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9ea67251-768e-46b1-8619-083b72bff6dc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:08.151269 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9ea67251-768e-46b1-8619-083b72bff6dc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:08.157883 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9ea67251-768e-46b1-8619-083b72bff6dc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:08.158464 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9ea67251-768e-46b1-8619-083b72bff6dc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:08.159481 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9ea67251-768e-46b1-8619-083b72bff6dc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:08.160213 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9ea67251-768e-46b1-8619-083b72bff6dc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:08.296657 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e4001a35-1ce1-4fdf-af2a-47d3b9291bd7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:08.298169 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e4001a35-1ce1-4fdf-af2a-47d3b9291bd7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:08.309709 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e4001a35-1ce1-4fdf-af2a-47d3b9291bd7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:08.310968 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e4001a35-1ce1-4fdf-af2a-47d3b9291bd7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:08.312333 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e4001a35-1ce1-4fdf-af2a-47d3b9291bd7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:08.317684 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e4001a35-1ce1-4fdf-af2a-47d3b9291bd7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:08.337066 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-e4001a35-1ce1-4fdf-af2a-47d3b9291bd7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] HTTP exception thrown: Instance 3fa85ce7-f190-47c1-bf94-e1d5d7b98070 could not be found. Jan 19 13:06:08.337996 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e4001a35-1ce1-4fdf-af2a-47d3b9291bd7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Returning 404 to user: Instance 3fa85ce7-f190-47c1-bf94-e1d5d7b98070 could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:08.338952 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e4001a35-1ce1-4fdf-af2a-47d3b9291bd7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 404 len: 111 microversion: 2.1 time: 0.047067 Jan 19 13:06:08.339619 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-9ea67251-768e-46b1-8619-083b72bff6dc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:08.339766 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 166/321] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:08 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 13:06:08.353866 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9ea67251-768e-46b1-8619-083b72bff6dc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 200 len: 1314 microversion: 2.1 time: 0.206577 Jan 19 13:06:08.354192 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0b85f953-0789-4f0d-b638-0ad8945925f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:08.354872 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 156/322] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:08 2022] GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:08.355858 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0b85f953-0789-4f0d-b638-0ad8945925f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:08.362281 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0b85f953-0789-4f0d-b638-0ad8945925f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:08.363505 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0b85f953-0789-4f0d-b638-0ad8945925f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:08.364360 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0b85f953-0789-4f0d-b638-0ad8945925f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:08.364970 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0b85f953-0789-4f0d-b638-0ad8945925f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:08.480489 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-34248ac8-7639-4255-b913-bee9276211e9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:08.481511 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-34248ac8-7639-4255-b913-bee9276211e9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:08.486216 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0b85f953-0789-4f0d-b638-0ad8945925f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 25817 microversion: 2.1 time: 0.137952 Jan 19 13:06:08.487606 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 167/323] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:08 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 25817 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:08.499558 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-34248ac8-7639-4255-b913-bee9276211e9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:08.501998 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-34248ac8-7639-4255-b913-bee9276211e9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:08.502998 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-34248ac8-7639-4255-b913-bee9276211e9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:08.503422 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-34248ac8-7639-4255-b913-bee9276211e9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:08.517885 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-34248ac8-7639-4255-b913-bee9276211e9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] HTTP exception thrown: Instance 3fa85ce7-f190-47c1-bf94-e1d5d7b98070 could not be found. Jan 19 13:06:08.518578 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-34248ac8-7639-4255-b913-bee9276211e9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Returning 404 to user: Instance 3fa85ce7-f190-47c1-bf94-e1d5d7b98070 could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:08.519474 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-34248ac8-7639-4255-b913-bee9276211e9 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043442 Jan 19 13:06:08.520069 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 157/324] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:06:08 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 13:06:08.832856 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8c5bb2aa-0394-4554-986a-0a6bcbe66270 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:08.833910 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8c5bb2aa-0394-4554-986a-0a6bcbe66270 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:08.842844 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c5bb2aa-0394-4554-986a-0a6bcbe66270 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:08.843458 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c5bb2aa-0394-4554-986a-0a6bcbe66270 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:08.844424 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c5bb2aa-0394-4554-986a-0a6bcbe66270 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:08.844854 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c5bb2aa-0394-4554-986a-0a6bcbe66270 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:08.924544 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a4879b79-d444-464f-8d8a-5e45cebcfbdc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:08.927290 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a4879b79-d444-464f-8d8a-5e45cebcfbdc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:08.936933 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a4879b79-d444-464f-8d8a-5e45cebcfbdc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:08.937386 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a4879b79-d444-464f-8d8a-5e45cebcfbdc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:08.940863 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a4879b79-d444-464f-8d8a-5e45cebcfbdc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:08.945069 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a4879b79-d444-464f-8d8a-5e45cebcfbdc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:09.044854 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a4879b79-d444-464f-8d8a-5e45cebcfbdc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 25824 microversion: 2.20 time: 0.123582 Jan 19 13:06:09.045729 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 158/325] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:08 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 25824 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:06:09.048632 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-8c5bb2aa-0394-4554-986a-0a6bcbe66270 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:09.064045 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8c5bb2aa-0394-4554-986a-0a6bcbe66270 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.235233 Jan 19 13:06:09.065098 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 168/326] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:08 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:09.377131 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-653ce33a-c6de-4e59-ad76-d1d6794b826c tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:09.380101 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-653ce33a-c6de-4e59-ad76-d1d6794b826c tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:09.388704 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-653ce33a-c6de-4e59-ad76-d1d6794b826c tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:09.389309 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-653ce33a-c6de-4e59-ad76-d1d6794b826c tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:09.390247 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-653ce33a-c6de-4e59-ad76-d1d6794b826c tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:09.391198 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-653ce33a-c6de-4e59-ad76-d1d6794b826c tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:09.500149 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c23d07ff-3fcd-46ff-9dc9-9205863452e7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:09.501078 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c23d07ff-3fcd-46ff-9dc9-9205863452e7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:09.507340 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c23d07ff-3fcd-46ff-9dc9-9205863452e7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:09.508200 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c23d07ff-3fcd-46ff-9dc9-9205863452e7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:09.509133 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c23d07ff-3fcd-46ff-9dc9-9205863452e7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:09.509571 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c23d07ff-3fcd-46ff-9dc9-9205863452e7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:09.552950 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-653ce33a-c6de-4e59-ad76-d1d6794b826c tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:09.560403 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-653ce33a-c6de-4e59-ad76-d1d6794b826c tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 200 len: 1314 microversion: 2.1 time: 0.187580 Jan 19 13:06:09.561007 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 159/327] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:09 2022] GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:09.590190 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c23d07ff-3fcd-46ff-9dc9-9205863452e7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 26712 microversion: 2.1 time: 0.094093 Jan 19 13:06:09.590824 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 169/328] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:09 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 26712 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:09.766496 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ff2c733c-e750-44d8-bb5c-7b28fa2816f3 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:09.766981 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ff2c733c-e750-44d8-bb5c-7b28fa2816f3 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:09.773929 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff2c733c-e750-44d8-bb5c-7b28fa2816f3 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:09.774371 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff2c733c-e750-44d8-bb5c-7b28fa2816f3 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:09.775133 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff2c733c-e750-44d8-bb5c-7b28fa2816f3 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:09.775563 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff2c733c-e750-44d8-bb5c-7b28fa2816f3 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:09.789008 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-ff2c733c-e750-44d8-bb5c-7b28fa2816f3 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] HTTP exception thrown: Instance 3fa85ce7-f190-47c1-bf94-e1d5d7b98070 could not be found. Jan 19 13:06:09.789582 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ff2c733c-e750-44d8-bb5c-7b28fa2816f3 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Returning 404 to user: Instance 3fa85ce7-f190-47c1-bf94-e1d5d7b98070 could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:09.790378 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ff2c733c-e750-44d8-bb5c-7b28fa2816f3 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 404 len: 111 microversion: 2.1 time: 0.027817 Jan 19 13:06:09.790889 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 160/329] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:06:09 2022] DELETE /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:06:09.799429 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9dc24ddb-1807-4a68-b340-c02caf0096f7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:09.800266 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9dc24ddb-1807-4a68-b340-c02caf0096f7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] [instance: 3fa85ce7-f190-47c1-bf94-e1d5d7b98070] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:09.807509 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9dc24ddb-1807-4a68-b340-c02caf0096f7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:09.807952 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9dc24ddb-1807-4a68-b340-c02caf0096f7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:09.808745 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9dc24ddb-1807-4a68-b340-c02caf0096f7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:09.809172 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9dc24ddb-1807-4a68-b340-c02caf0096f7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:09.823609 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-9dc24ddb-1807-4a68-b340-c02caf0096f7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] HTTP exception thrown: Instance 3fa85ce7-f190-47c1-bf94-e1d5d7b98070 could not be found. Jan 19 13:06:09.824211 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9dc24ddb-1807-4a68-b340-c02caf0096f7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] Returning 404 to user: Instance 3fa85ce7-f190-47c1-bf94-e1d5d7b98070 could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:09.825011 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9dc24ddb-1807-4a68-b340-c02caf0096f7 tempest-DeleteServersTestJSON-864188492 tempest-DeleteServersTestJSON-864188492-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070" status: 404 len: 111 microversion: 2.1 time: 0.029551 Jan 19 13:06:09.825527 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 170/330] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:09 2022] GET /compute/v2.1/servers/3fa85ce7-f190-47c1-bf94-e1d5d7b98070 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:06:10.057624 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4de101e5-e414-48fa-a323-2fb2d30743e4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:10.058563 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4de101e5-e414-48fa-a323-2fb2d30743e4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:10.068515 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4de101e5-e414-48fa-a323-2fb2d30743e4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:10.068967 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4de101e5-e414-48fa-a323-2fb2d30743e4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:10.069752 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4de101e5-e414-48fa-a323-2fb2d30743e4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:10.070183 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4de101e5-e414-48fa-a323-2fb2d30743e4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:10.082673 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-eb2e874d-a82f-43ef-93cc-394c25579ba6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:10.083273 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-eb2e874d-a82f-43ef-93cc-394c25579ba6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:10.089519 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb2e874d-a82f-43ef-93cc-394c25579ba6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:10.090183 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb2e874d-a82f-43ef-93cc-394c25579ba6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:10.091314 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb2e874d-a82f-43ef-93cc-394c25579ba6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:10.091955 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb2e874d-a82f-43ef-93cc-394c25579ba6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:10.162013 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4de101e5-e414-48fa-a323-2fb2d30743e4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 26630 microversion: 2.20 time: 0.108770 Jan 19 13:06:10.163315 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 161/331] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:10 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 26630 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:06:10.254710 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-eb2e874d-a82f-43ef-93cc-394c25579ba6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:10.264519 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-eb2e874d-a82f-43ef-93cc-394c25579ba6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.185736 Jan 19 13:06:10.265246 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 171/332] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:10 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:06:10.577600 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-83dcd6ee-0ef1-4521-b48f-8d24f022daa5 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:10.578303 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-83dcd6ee-0ef1-4521-b48f-8d24f022daa5 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:10.586925 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-83dcd6ee-0ef1-4521-b48f-8d24f022daa5 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:10.587377 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-83dcd6ee-0ef1-4521-b48f-8d24f022daa5 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:10.588294 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-83dcd6ee-0ef1-4521-b48f-8d24f022daa5 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:10.589171 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-83dcd6ee-0ef1-4521-b48f-8d24f022daa5 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:10.602864 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d1a2c635-3747-433f-bc38-5688732ad9b2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:10.604708 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d1a2c635-3747-433f-bc38-5688732ad9b2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:10.612044 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d1a2c635-3747-433f-bc38-5688732ad9b2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:10.613031 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d1a2c635-3747-433f-bc38-5688732ad9b2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:10.614309 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d1a2c635-3747-433f-bc38-5688732ad9b2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:10.615162 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d1a2c635-3747-433f-bc38-5688732ad9b2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:10.792238 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d1a2c635-3747-433f-bc38-5688732ad9b2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 27352 microversion: 2.1 time: 0.193055 Jan 19 13:06:10.794412 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 172/333] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:10 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 27352 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:10.846395 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-83dcd6ee-0ef1-4521-b48f-8d24f022daa5 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:10.856240 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-83dcd6ee-0ef1-4521-b48f-8d24f022daa5 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 200 len: 1314 microversion: 2.1 time: 0.282798 Jan 19 13:06:10.857483 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 162/334] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:10 2022] GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:11.174810 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7f8b46ae-2eca-41c2-b4d6-f92dccf1bf3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:11.176780 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7f8b46ae-2eca-41c2-b4d6-f92dccf1bf3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:11.183645 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f8b46ae-2eca-41c2-b4d6-f92dccf1bf3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:11.184394 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f8b46ae-2eca-41c2-b4d6-f92dccf1bf3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:11.185391 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f8b46ae-2eca-41c2-b4d6-f92dccf1bf3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:11.186009 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f8b46ae-2eca-41c2-b4d6-f92dccf1bf3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:11.287073 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7f8b46ae-2eca-41c2-b4d6-f92dccf1bf3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 27309 microversion: 2.20 time: 0.115634 Jan 19 13:06:11.288185 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 173/335] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:11 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 27309 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:11.289609 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d52dae2d-b06f-4dff-b7c1-523ff638b835 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:11.290233 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d52dae2d-b06f-4dff-b7c1-523ff638b835 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:11.301189 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d52dae2d-b06f-4dff-b7c1-523ff638b835 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:11.301737 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d52dae2d-b06f-4dff-b7c1-523ff638b835 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:11.303094 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d52dae2d-b06f-4dff-b7c1-523ff638b835 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:11.304316 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d52dae2d-b06f-4dff-b7c1-523ff638b835 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:11.454806 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-5085a05b-9a20-4ed8-bbd9-9869e5cf2b90 req-85dd50bf-8453-4c19-8dd7-275cd320d213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc6ff9a-b69e-4da7-b919-cfb76d90895c", "name": "network-vif-plugged", "status": "completed", "tag": "aaef8b17-3d61-4230-bf03-76181085c780"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:11.457476 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:06:11.457476 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:06:11.466202 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-5085a05b-9a20-4ed8-bbd9-9869e5cf2b90 req-85dd50bf-8453-4c19-8dd7-275cd320d213 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:11.466648 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-5085a05b-9a20-4ed8-bbd9-9869e5cf2b90 req-85dd50bf-8453-4c19-8dd7-275cd320d213 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:11.488365 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-5085a05b-9a20-4ed8-bbd9-9869e5cf2b90 req-85dd50bf-8453-4c19-8dd7-275cd320d213 service nova] Creating event network-vif-plugged:aaef8b17-3d61-4230-bf03-76181085c780 for instance 8cc6ff9a-b69e-4da7-b919-cfb76d90895c on hv-cinder-82301 Jan 19 13:06:11.494977 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-5085a05b-9a20-4ed8-bbd9-9869e5cf2b90 req-85dd50bf-8453-4c19-8dd7-275cd320d213 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044097 Jan 19 13:06:11.496168 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 174/336] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:06:11.517034 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d52dae2d-b06f-4dff-b7c1-523ff638b835 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:11.547589 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d52dae2d-b06f-4dff-b7c1-523ff638b835 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.262497 Jan 19 13:06:11.554573 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 163/337] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:11 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:06:11.806453 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8d7eae87-a52d-4e68-9318-8275e7d60e71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:11.807772 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8d7eae87-a52d-4e68-9318-8275e7d60e71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:11.823240 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8d7eae87-a52d-4e68-9318-8275e7d60e71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:11.823697 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8d7eae87-a52d-4e68-9318-8275e7d60e71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:11.824553 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8d7eae87-a52d-4e68-9318-8275e7d60e71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:11.825047 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8d7eae87-a52d-4e68-9318-8275e7d60e71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:11.873669 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f085700e-5eab-4e1a-b75a-4ff2047bf199 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:11.874947 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f085700e-5eab-4e1a-b75a-4ff2047bf199 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:11.883039 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f085700e-5eab-4e1a-b75a-4ff2047bf199 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:11.883592 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f085700e-5eab-4e1a-b75a-4ff2047bf199 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:11.884495 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f085700e-5eab-4e1a-b75a-4ff2047bf199 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:11.885006 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f085700e-5eab-4e1a-b75a-4ff2047bf199 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:12.058127 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f085700e-5eab-4e1a-b75a-4ff2047bf199 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:12.066605 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f085700e-5eab-4e1a-b75a-4ff2047bf199 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 200 len: 1314 microversion: 2.1 time: 0.196167 Jan 19 13:06:12.074139 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 164/338] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:11 2022] GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:12.183130 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8d7eae87-a52d-4e68-9318-8275e7d60e71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 27721 microversion: 2.1 time: 0.380335 Jan 19 13:06:12.183912 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 175/339] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:11 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 27721 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:12.299810 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a839caa1-2ef9-4908-b4ef-08ae1de9cd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:12.301133 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a839caa1-2ef9-4908-b4ef-08ae1de9cd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:12.308873 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a839caa1-2ef9-4908-b4ef-08ae1de9cd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:12.309269 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a839caa1-2ef9-4908-b4ef-08ae1de9cd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:12.310056 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a839caa1-2ef9-4908-b4ef-08ae1de9cd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:12.310496 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a839caa1-2ef9-4908-b4ef-08ae1de9cd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:12.413688 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-59b12a5c-426b-4c92-b229-ad21c3026e97 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Action: 'create', calling method: .version_select at 0x7f07e459f4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-658412736"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:12.422937 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a839caa1-2ef9-4908-b4ef-08ae1de9cd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 27687 microversion: 2.20 time: 0.126911 Jan 19 13:06:12.424446 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 176/340] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:12 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 27687 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:12.573873 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-feed0e7c-1c7f-4861-bd48-dda055d05d24 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:12.574474 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-feed0e7c-1c7f-4861-bd48-dda055d05d24 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:12.583216 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-feed0e7c-1c7f-4861-bd48-dda055d05d24 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:12.583854 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-feed0e7c-1c7f-4861-bd48-dda055d05d24 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:12.584671 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-feed0e7c-1c7f-4861-bd48-dda055d05d24 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:12.585109 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-feed0e7c-1c7f-4861-bd48-dda055d05d24 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:12.724896 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-feed0e7c-1c7f-4861-bd48-dda055d05d24 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:12.725796 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-59b12a5c-426b-4c92-b229-ad21c3026e97 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.571082 Jan 19 13:06:12.726420 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 165/341] 10.222.0.48 () {60 vars in 1154 bytes} [Wed Jan 19 13:06:12 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 573 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 19 13:06:12.735189 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-feed0e7c-1c7f-4861-bd48-dda055d05d24 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.166212 Jan 19 13:06:12.735761 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 177/342] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:12 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:12.737068 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-69d8817b-172e-43ee-9c34-4ad4bf70b579 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07e46984c0>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:12.791039 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-69d8817b-172e-43ee-9c34-4ad4bf70b579 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/98522407-7cc1-4844-8681-8116459faf79" status: 200 len: 344 microversion: 2.1 time: 0.057701 Jan 19 13:06:12.791682 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 166/343] 10.222.0.48 () {58 vars in 1244 bytes} [Wed Jan 19 13:06:12 2022] GET /compute/v2.1/os-volumes/98522407-7cc1-4844-8681-8116459faf79 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:06:13.088790 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-80be45c5-6e45-4f0a-ba19-3fd2e33824fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:13.089396 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-80be45c5-6e45-4f0a-ba19-3fd2e33824fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:13.096436 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-80be45c5-6e45-4f0a-ba19-3fd2e33824fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:13.097508 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-80be45c5-6e45-4f0a-ba19-3fd2e33824fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:13.098461 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-80be45c5-6e45-4f0a-ba19-3fd2e33824fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:13.098904 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-80be45c5-6e45-4f0a-ba19-3fd2e33824fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:13.200584 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-8a0bcef5-8e3f-4f16-9be8-3acd57b11858 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:13.202161 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-8a0bcef5-8e3f-4f16-9be8-3acd57b11858 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:13.212280 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8a0bcef5-8e3f-4f16-9be8-3acd57b11858 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:13.213021 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8a0bcef5-8e3f-4f16-9be8-3acd57b11858 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:13.214072 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8a0bcef5-8e3f-4f16-9be8-3acd57b11858 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:13.215088 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8a0bcef5-8e3f-4f16-9be8-3acd57b11858 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:13.249754 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-80be45c5-6e45-4f0a-ba19-3fd2e33824fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:13.258204 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-80be45c5-6e45-4f0a-ba19-3fd2e33824fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 200 len: 1314 microversion: 2.1 time: 0.172998 Jan 19 13:06:13.258765 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 178/344] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:13 2022] GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:13.334455 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-8a0bcef5-8e3f-4f16-9be8-3acd57b11858 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 27958 microversion: 2.1 time: 0.140336 Jan 19 13:06:13.335456 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 167/345] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:13 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 27958 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:13.436784 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a1d71290-607b-4774-bfe3-c866ce9c8758 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:13.437723 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a1d71290-607b-4774-bfe3-c866ce9c8758 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:13.446889 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a1d71290-607b-4774-bfe3-c866ce9c8758 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:13.447691 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a1d71290-607b-4774-bfe3-c866ce9c8758 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:13.449177 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a1d71290-607b-4774-bfe3-c866ce9c8758 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:13.450379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a1d71290-607b-4774-bfe3-c866ce9c8758 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:13.561211 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a1d71290-607b-4774-bfe3-c866ce9c8758 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 27901 microversion: 2.20 time: 0.128648 Jan 19 13:06:13.561924 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 179/346] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:13 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 27901 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:13.755444 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-95aeab8c-ff92-4a4e-b406-01f7a246fe91 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:13.756249 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-95aeab8c-ff92-4a4e-b406-01f7a246fe91 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:13.765173 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-95aeab8c-ff92-4a4e-b406-01f7a246fe91 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:13.765871 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-95aeab8c-ff92-4a4e-b406-01f7a246fe91 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:13.766979 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-95aeab8c-ff92-4a4e-b406-01f7a246fe91 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:13.767626 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-95aeab8c-ff92-4a4e-b406-01f7a246fe91 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:13.805444 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-be7c45c2-2c95-45cb-9d87-574aa08fc2f3 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07d7ffbee0>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:13.922476 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-be7c45c2-2c95-45cb-9d87-574aa08fc2f3 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/98522407-7cc1-4844-8681-8116459faf79" status: 200 len: 345 microversion: 2.1 time: 0.122230 Jan 19 13:06:13.923057 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 180/347] 10.222.0.48 () {58 vars in 1244 bytes} [Wed Jan 19 13:06:13 2022] GET /compute/v2.1/os-volumes/98522407-7cc1-4844-8681-8116459faf79 => generated 345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:06:13.936710 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-343436e9-4af6-4e3c-884f-97053810b32c tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Action: 'create', calling method: .version_select at 0x7f07d7eae670>, body: {"snapshot": {"volume_id": "98522407-7cc1-4844-8681-8116459faf79", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-201388199"}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:13.957450 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-95aeab8c-ff92-4a4e-b406-01f7a246fe91 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:13.965727 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-95aeab8c-ff92-4a4e-b406-01f7a246fe91 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.216078 Jan 19 13:06:13.966302 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 168/348] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:13 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:14.116541 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-343436e9-4af6-4e3c-884f-97053810b32c tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.184870 Jan 19 13:06:14.117837 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 181/349] 10.222.0.48 () {60 vars in 1161 bytes} [Wed Jan 19 13:06:13 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:06:14.131120 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d5a7c064-3d94-424b-bd4b-467e02e0bef6 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07e4681700>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:14.211432 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d5a7c064-3d94-424b-bd4b-467e02e0bef6 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3" status: 200 len: 286 microversion: 2.1 time: 0.087226 Jan 19 13:06:14.213234 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 169/350] 10.222.0.48 () {58 vars in 1250 bytes} [Wed Jan 19 13:06:14 2022] GET /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3 => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:06:14.225935 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-912b2ce9-64a8-428e-9fe9-c7fa2191543a tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07d7f41040>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:14.275391 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b225dd26-079d-497f-b440-42c4d82b8ac1 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:14.276177 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b225dd26-079d-497f-b440-42c4d82b8ac1 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:14.284166 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b225dd26-079d-497f-b440-42c4d82b8ac1 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:14.285347 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b225dd26-079d-497f-b440-42c4d82b8ac1 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:14.303934 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-912b2ce9-64a8-428e-9fe9-c7fa2191543a tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.069132 Jan 19 13:06:14.303934 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 182/351] 10.222.0.48 () {58 vars in 1139 bytes} [Wed Jan 19 13:06:14 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:06:14.304158 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b225dd26-079d-497f-b440-42c4d82b8ac1 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:14.304158 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b225dd26-079d-497f-b440-42c4d82b8ac1 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:14.305579 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b0cf7420-9823-4ea6-b700-85f55aa20f24 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07d7e33e50>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:14.396486 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b0cf7420-9823-4ea6-b700-85f55aa20f24 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3" status: 200 len: 286 microversion: 2.1 time: 0.101394 Jan 19 13:06:14.397265 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 183/352] 10.222.0.48 () {58 vars in 1250 bytes} [Wed Jan 19 13:06:14 2022] GET /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3 => generated 286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:06:14.412109 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2a57a253-1c83-4881-8107-bdec7bea3ace tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:14.413784 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2a57a253-1c83-4881-8107-bdec7bea3ace tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:14.424476 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2a57a253-1c83-4881-8107-bdec7bea3ace tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:14.425259 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2a57a253-1c83-4881-8107-bdec7bea3ace tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:14.429959 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2a57a253-1c83-4881-8107-bdec7bea3ace tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:14.431049 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2a57a253-1c83-4881-8107-bdec7bea3ace tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:14.493363 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b225dd26-079d-497f-b440-42c4d82b8ac1 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:14.500970 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b225dd26-079d-497f-b440-42c4d82b8ac1 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 200 len: 1499 microversion: 2.1 time: 0.229323 Jan 19 13:06:14.501484 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 170/353] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:14 2022] GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 1499 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:14.542179 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2a57a253-1c83-4881-8107-bdec7bea3ace tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28076 microversion: 2.1 time: 0.142585 Jan 19 13:06:14.543598 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 184/354] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:14 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28076 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:14.573035 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-578c11ce-8b91-4c1c-91b5-a93d50f03301 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:14.574405 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-578c11ce-8b91-4c1c-91b5-a93d50f03301 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:14.581927 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-578c11ce-8b91-4c1c-91b5-a93d50f03301 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:14.582428 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-578c11ce-8b91-4c1c-91b5-a93d50f03301 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:14.583300 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-578c11ce-8b91-4c1c-91b5-a93d50f03301 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:14.583760 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-578c11ce-8b91-4c1c-91b5-a93d50f03301 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:14.948461 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-578c11ce-8b91-4c1c-91b5-a93d50f03301 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28167 microversion: 2.20 time: 0.378804 Jan 19 13:06:14.949605 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 171/355] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:14 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28167 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:14.983060 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-82e613b6-0207-40cb-af8c-b335fc4cc598 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:14.983747 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-82e613b6-0207-40cb-af8c-b335fc4cc598 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:14.992017 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-82e613b6-0207-40cb-af8c-b335fc4cc598 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:14.992476 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-82e613b6-0207-40cb-af8c-b335fc4cc598 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:14.993342 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-82e613b6-0207-40cb-af8c-b335fc4cc598 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:14.994011 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-82e613b6-0207-40cb-af8c-b335fc4cc598 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:15.151574 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-82e613b6-0207-40cb-af8c-b335fc4cc598 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:15.163121 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-82e613b6-0207-40cb-af8c-b335fc4cc598 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.180389 Jan 19 13:06:15.163121 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 185/356] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:14 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:15.408641 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9ae6dc42-9e10-4458-ad22-048f075da405 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07e468d790>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:15.495276 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9ae6dc42-9e10-4458-ad22-048f075da405 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3" status: 200 len: 286 microversion: 2.1 time: 0.090616 Jan 19 13:06:15.496029 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 172/357] 10.222.0.48 () {58 vars in 1250 bytes} [Wed Jan 19 13:06:15 2022] GET /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:06:15.555051 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-df3e15b9-c971-42ab-abab-04d285b51fc2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:15.558279 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-df3e15b9-c971-42ab-abab-04d285b51fc2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:15.563917 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-df3e15b9-c971-42ab-abab-04d285b51fc2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:15.564485 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-df3e15b9-c971-42ab-abab-04d285b51fc2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:15.565419 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-df3e15b9-c971-42ab-abab-04d285b51fc2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:15.567170 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-df3e15b9-c971-42ab-abab-04d285b51fc2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:15.961226 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-fcdc5d41-d88d-45f6-8794-1dd3eff90dfb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:15.962300 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-fcdc5d41-d88d-45f6-8794-1dd3eff90dfb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:15.968224 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fcdc5d41-d88d-45f6-8794-1dd3eff90dfb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:15.968674 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fcdc5d41-d88d-45f6-8794-1dd3eff90dfb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:15.969443 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fcdc5d41-d88d-45f6-8794-1dd3eff90dfb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:15.969876 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fcdc5d41-d88d-45f6-8794-1dd3eff90dfb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:18.359118 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-df3e15b9-c971-42ab-abab-04d285b51fc2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28076 microversion: 2.1 time: 2.807419 Jan 19 13:06:18.359850 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 186/358] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:15 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28076 bytes in 2810 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:18.367367 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2ca087c0-a904-4af1-811d-8ab6bcd6ee57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:18.368115 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2ca087c0-a904-4af1-811d-8ab6bcd6ee57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:18.374916 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ca087c0-a904-4af1-811d-8ab6bcd6ee57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:18.375368 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ca087c0-a904-4af1-811d-8ab6bcd6ee57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:18.376239 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ca087c0-a904-4af1-811d-8ab6bcd6ee57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:18.376673 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ca087c0-a904-4af1-811d-8ab6bcd6ee57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:18.509678 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2ca087c0-a904-4af1-811d-8ab6bcd6ee57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:18.517221 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2ca087c0-a904-4af1-811d-8ab6bcd6ee57 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.156029 Jan 19 13:06:18.517975 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 187/359] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:18 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:18.522618 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-76bc6c1a-86c6-4156-bec2-6b0e330b32e9 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07d7ea34c0>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:18.552892 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-76bc6c1a-86c6-4156-bec2-6b0e330b32e9 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3" status: 200 len: 286 microversion: 2.1 time: 0.032432 Jan 19 13:06:18.552892 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 188/360] 10.222.0.48 () {58 vars in 1250 bytes} [Wed Jan 19 13:06:18 2022] GET /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:06:18.645248 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-fcdc5d41-d88d-45f6-8794-1dd3eff90dfb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28167 microversion: 2.20 time: 2.687955 Jan 19 13:06:18.649122 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 173/361] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:15 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28167 bytes in 2690 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:06:19.379105 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b977a6e6-0021-413c-a17d-e120a0ebc49a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:19.382787 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b977a6e6-0021-413c-a17d-e120a0ebc49a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:19.384805 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-309dbbe7-3b6f-4c42-bb10-e5f9e828f1a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:19.385456 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-309dbbe7-3b6f-4c42-bb10-e5f9e828f1a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:19.394205 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-309dbbe7-3b6f-4c42-bb10-e5f9e828f1a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:19.395064 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-309dbbe7-3b6f-4c42-bb10-e5f9e828f1a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:19.396305 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-309dbbe7-3b6f-4c42-bb10-e5f9e828f1a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:19.396994 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-309dbbe7-3b6f-4c42-bb10-e5f9e828f1a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:19.404054 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b977a6e6-0021-413c-a17d-e120a0ebc49a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:19.404367 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b977a6e6-0021-413c-a17d-e120a0ebc49a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:19.405197 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b977a6e6-0021-413c-a17d-e120a0ebc49a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:19.405709 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b977a6e6-0021-413c-a17d-e120a0ebc49a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:19.433774 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-309dbbe7-3b6f-4c42-bb10-e5f9e828f1a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Going to try to terminate instance {{(pid=116360) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:06:19.525419 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b977a6e6-0021-413c-a17d-e120a0ebc49a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28193 microversion: 2.1 time: 0.153991 Jan 19 13:06:19.526317 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 189/362] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:19 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28193 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:19.528637 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-309dbbe7-3b6f-4c42-bb10-e5f9e828f1a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 204 len: 0 microversion: 2.1 time: 0.147925 Jan 19 13:06:19.529537 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 174/363] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:06:19 2022] DELETE /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:06:19.537359 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f768951e-d011-40cc-aafa-d4699c85df63 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:19.538050 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f768951e-d011-40cc-aafa-d4699c85df63 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:19.539554 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-1d352ce3-f131-4a77-bbf3-1c05ab78f63d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:19.540315 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-1d352ce3-f131-4a77-bbf3-1c05ab78f63d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:19.546473 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f768951e-d011-40cc-aafa-d4699c85df63 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:19.546913 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1d352ce3-f131-4a77-bbf3-1c05ab78f63d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:19.547034 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f768951e-d011-40cc-aafa-d4699c85df63 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:19.547368 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1d352ce3-f131-4a77-bbf3-1c05ab78f63d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:19.547693 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f768951e-d011-40cc-aafa-d4699c85df63 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:19.548159 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f768951e-d011-40cc-aafa-d4699c85df63 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:19.548291 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1d352ce3-f131-4a77-bbf3-1c05ab78f63d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:19.548619 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1d352ce3-f131-4a77-bbf3-1c05ab78f63d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:19.778189 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-1d352ce3-f131-4a77-bbf3-1c05ab78f63d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:19.782591 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f768951e-d011-40cc-aafa-d4699c85df63 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:19.786291 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-1d352ce3-f131-4a77-bbf3-1c05ab78f63d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 200 len: 1505 microversion: 2.1 time: 0.251741 Jan 19 13:06:19.786883 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 175/364] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:19 2022] GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 1505 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:06:19.795767 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f768951e-d011-40cc-aafa-d4699c85df63 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.259711 Jan 19 13:06:19.795767 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 190/365] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:19 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:19.795961 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d8202094-b8bc-43cc-92d3-eb98a7e34877 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07e4743700>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:19.799829 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b23cd04f-264a-4ab0-b7d9-8e69a9c43dbd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:19.800984 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b23cd04f-264a-4ab0-b7d9-8e69a9c43dbd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:19.807555 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b23cd04f-264a-4ab0-b7d9-8e69a9c43dbd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:19.808150 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b23cd04f-264a-4ab0-b7d9-8e69a9c43dbd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:19.808828 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b23cd04f-264a-4ab0-b7d9-8e69a9c43dbd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:19.809909 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b23cd04f-264a-4ab0-b7d9-8e69a9c43dbd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:19.823217 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d8202094-b8bc-43cc-92d3-eb98a7e34877 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3" status: 200 len: 287 microversion: 2.1 time: 0.035248 Jan 19 13:06:19.823790 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 176/366] 10.222.0.48 () {58 vars in 1250 bytes} [Wed Jan 19 13:06:19 2022] GET /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:06:19.834148 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b0b0f4f9-22d8-40d8-8f0c-f14d24e427c4 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07e46945e0>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:19.871904 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b23cd04f-264a-4ab0-b7d9-8e69a9c43dbd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28167 microversion: 2.20 time: 0.079342 Jan 19 13:06:19.872846 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 191/367] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:19 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28167 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:19.892236 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b0b0f4f9-22d8-40d8-8f0c-f14d24e427c4 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3" status: 202 len: 0 microversion: 2.1 time: 0.061995 Jan 19 13:06:19.892801 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 177/368] 10.222.0.48 () {58 vars in 1253 bytes} [Wed Jan 19 13:06:19 2022] DELETE /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:06:19.902602 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-dbbcef2e-7514-484d-b0d0-6f593c50e14e tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07d7e074c0>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:19.930717 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-dbbcef2e-7514-484d-b0d0-6f593c50e14e tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3" status: 200 len: 286 microversion: 2.1 time: 0.032383 Jan 19 13:06:19.931273 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 192/369] 10.222.0.48 () {58 vars in 1250 bytes} [Wed Jan 19 13:06:19 2022] GET /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:06:20.538525 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b19f1c17-7f6a-4d2e-bc19-d5adaa12015f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:20.539678 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b19f1c17-7f6a-4d2e-bc19-d5adaa12015f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:20.547269 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b19f1c17-7f6a-4d2e-bc19-d5adaa12015f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:20.547728 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b19f1c17-7f6a-4d2e-bc19-d5adaa12015f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:20.548543 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b19f1c17-7f6a-4d2e-bc19-d5adaa12015f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:20.549103 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b19f1c17-7f6a-4d2e-bc19-d5adaa12015f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:20.610254 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b19f1c17-7f6a-4d2e-bc19-d5adaa12015f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28193 microversion: 2.1 time: 0.076603 Jan 19 13:06:20.611631 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 178/370] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:20 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28193 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:20.803784 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2e22c427-1c6e-4913-8855-50740bcfb16f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:20.804537 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2e22c427-1c6e-4913-8855-50740bcfb16f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:20.809199 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a9752615-e8f9-4e69-bfb1-c57e33aec5d7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:20.811667 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a9752615-e8f9-4e69-bfb1-c57e33aec5d7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:20.817238 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2e22c427-1c6e-4913-8855-50740bcfb16f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:20.817955 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2e22c427-1c6e-4913-8855-50740bcfb16f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:20.819324 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2e22c427-1c6e-4913-8855-50740bcfb16f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:20.820093 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2e22c427-1c6e-4913-8855-50740bcfb16f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:20.823377 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9752615-e8f9-4e69-bfb1-c57e33aec5d7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:20.824578 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9752615-e8f9-4e69-bfb1-c57e33aec5d7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:20.825838 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9752615-e8f9-4e69-bfb1-c57e33aec5d7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:20.827508 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9752615-e8f9-4e69-bfb1-c57e33aec5d7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:21.111796 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a9752615-e8f9-4e69-bfb1-c57e33aec5d7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:21.116848 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2e22c427-1c6e-4913-8855-50740bcfb16f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:21.120217 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a9752615-e8f9-4e69-bfb1-c57e33aec5d7 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.316082 Jan 19 13:06:21.121096 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 179/371] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:20 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:06:21.125541 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-cb31f92e-7282-49f8-b30b-820210459571 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:21.126500 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-cb31f92e-7282-49f8-b30b-820210459571 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:21.132991 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cb31f92e-7282-49f8-b30b-820210459571 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:21.133624 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cb31f92e-7282-49f8-b30b-820210459571 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:21.134552 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cb31f92e-7282-49f8-b30b-820210459571 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:21.135142 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cb31f92e-7282-49f8-b30b-820210459571 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:21.136849 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2e22c427-1c6e-4913-8855-50740bcfb16f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 200 len: 1505 microversion: 2.1 time: 0.337818 Jan 19 13:06:21.137996 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 193/372] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:20 2022] GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:21.142737 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-66daa60e-49f7-4930-81de-a3feab8b848f tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07d7e27af0>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:21.170665 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-66daa60e-49f7-4930-81de-a3feab8b848f tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] HTTP exception thrown: Snapshot 9ef2948f-5697-402c-8515-7769d7dbf4e3 could not be found. Jan 19 13:06:21.171287 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-66daa60e-49f7-4930-81de-a3feab8b848f tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Returning 404 to user: Snapshot 9ef2948f-5697-402c-8515-7769d7dbf4e3 could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:21.172381 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-66daa60e-49f7-4930-81de-a3feab8b848f tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3" status: 404 len: 111 microversion: 2.1 time: 0.033391 Jan 19 13:06:21.172920 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 194/373] 10.222.0.48 () {58 vars in 1250 bytes} [Wed Jan 19 13:06:21 2022] GET /compute/v2.1/os-snapshots/9ef2948f-5697-402c-8515-7769d7dbf4e3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:06:21.181344 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-04d96a21-8425-4ce4-9547-eb6351842a57 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07d7e07940>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:21.223210 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-cb31f92e-7282-49f8-b30b-820210459571 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28167 microversion: 2.20 time: 0.100148 Jan 19 13:06:21.223951 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 180/374] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:21 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28167 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:21.250865 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-04d96a21-8425-4ce4-9547-eb6351842a57 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/98522407-7cc1-4844-8681-8116459faf79" status: 202 len: 0 microversion: 2.1 time: 0.072846 Jan 19 13:06:21.251513 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 195/375] 10.222.0.48 () {58 vars in 1247 bytes} [Wed Jan 19 13:06:21 2022] DELETE /compute/v2.1/os-volumes/98522407-7cc1-4844-8681-8116459faf79 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:06:21.260508 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c7b5d93d-18b4-4e74-a45c-7fb6ccfad372 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07e47439d0>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:21.309217 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c7b5d93d-18b4-4e74-a45c-7fb6ccfad372 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/98522407-7cc1-4844-8681-8116459faf79" status: 200 len: 344 microversion: 2.1 time: 0.053122 Jan 19 13:06:21.309779 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 181/376] 10.222.0.48 () {58 vars in 1244 bytes} [Wed Jan 19 13:06:21 2022] GET /compute/v2.1/os-volumes/98522407-7cc1-4844-8681-8116459faf79 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:06:21.623240 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f8badd69-1804-44de-b5b0-64468335a8ff tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:21.624513 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f8badd69-1804-44de-b5b0-64468335a8ff tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:21.638003 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f8badd69-1804-44de-b5b0-64468335a8ff tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:21.638657 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f8badd69-1804-44de-b5b0-64468335a8ff tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:21.640230 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f8badd69-1804-44de-b5b0-64468335a8ff tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:21.645691 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f8badd69-1804-44de-b5b0-64468335a8ff tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:21.721006 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f8badd69-1804-44de-b5b0-64468335a8ff tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28193 microversion: 2.1 time: 0.102262 Jan 19 13:06:21.721668 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 196/377] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:21 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28193 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:22.015914 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-e0010a91-bbdd-41b6-87f3-d4994032317d req-03107f83-93b2-44a9-95bf-397959399c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc6ff9a-b69e-4da7-b919-cfb76d90895c", "name": "network-vif-deleted", "tag": "aaef8b17-3d61-4230-bf03-76181085c780"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:22.017569 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:06:22.017569 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:06:22.026470 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-e0010a91-bbdd-41b6-87f3-d4994032317d req-03107f83-93b2-44a9-95bf-397959399c8c service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:22.026953 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-e0010a91-bbdd-41b6-87f3-d4994032317d req-03107f83-93b2-44a9-95bf-397959399c8c service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:22.038838 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-e0010a91-bbdd-41b6-87f3-d4994032317d req-03107f83-93b2-44a9-95bf-397959399c8c service nova] Creating event network-vif-deleted:aaef8b17-3d61-4230-bf03-76181085c780 for instance 8cc6ff9a-b69e-4da7-b919-cfb76d90895c on hv-cinder-82301 Jan 19 13:06:22.045121 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-e0010a91-bbdd-41b6-87f3-d4994032317d req-03107f83-93b2-44a9-95bf-397959399c8c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033751 Jan 19 13:06:22.046013 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 182/378] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:06:22.139274 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e17fac92-99c5-4c18-a594-d7cea24c7533 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:22.140123 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e17fac92-99c5-4c18-a594-d7cea24c7533 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:22.148371 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e17fac92-99c5-4c18-a594-d7cea24c7533 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:22.149228 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e17fac92-99c5-4c18-a594-d7cea24c7533 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:22.155512 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-fb2112b9-b101-446f-9ff7-59fddac1d2bc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:22.156595 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-fb2112b9-b101-446f-9ff7-59fddac1d2bc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:22.160494 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e17fac92-99c5-4c18-a594-d7cea24c7533 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:22.165960 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fb2112b9-b101-446f-9ff7-59fddac1d2bc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:22.166775 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e17fac92-99c5-4c18-a594-d7cea24c7533 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:22.168670 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fb2112b9-b101-446f-9ff7-59fddac1d2bc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:22.169700 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fb2112b9-b101-446f-9ff7-59fddac1d2bc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:22.170366 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fb2112b9-b101-446f-9ff7-59fddac1d2bc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:22.203702 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fb2112b9-b101-446f-9ff7-59fddac1d2bc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:22.204342 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fb2112b9-b101-446f-9ff7-59fddac1d2bc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:22.204883 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.objects.instance [None req-fb2112b9-b101-446f-9ff7-59fddac1d2bc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lazy-loading 'fault' on Instance uuid 8cc6ff9a-b69e-4da7-b919-cfb76d90895c {{(pid=116360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:06:22.282473 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-fb2112b9-b101-446f-9ff7-59fddac1d2bc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:22.294348 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-fb2112b9-b101-446f-9ff7-59fddac1d2bc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 200 len: 1304 microversion: 2.1 time: 0.143578 Jan 19 13:06:22.301828 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 183/379] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:22 2022] GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:22.308248 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f1947bda-15ec-443c-b222-c1547d3d4b6b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:22.309551 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f1947bda-15ec-443c-b222-c1547d3d4b6b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:22.317201 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f1947bda-15ec-443c-b222-c1547d3d4b6b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:22.317717 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f1947bda-15ec-443c-b222-c1547d3d4b6b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:22.318648 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f1947bda-15ec-443c-b222-c1547d3d4b6b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:22.319077 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f1947bda-15ec-443c-b222-c1547d3d4b6b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:22.368352 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e17fac92-99c5-4c18-a594-d7cea24c7533 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:22.381432 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e17fac92-99c5-4c18-a594-d7cea24c7533 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.246609 Jan 19 13:06:22.382678 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 197/380] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:22 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:22.395319 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f1947bda-15ec-443c-b222-c1547d3d4b6b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28167 microversion: 2.20 time: 0.090675 Jan 19 13:06:22.395633 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6ad5b937-dcd5-43c6-ba60-729cb590bd6e tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07d7e074c0>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:22.397863 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 184/381] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:22 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28167 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:22.430004 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-6ad5b937-dcd5-43c6-ba60-729cb590bd6e tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] HTTP exception thrown: Volume 98522407-7cc1-4844-8681-8116459faf79 could not be found. Jan 19 13:06:22.430812 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6ad5b937-dcd5-43c6-ba60-729cb590bd6e tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Returning 404 to user: Volume 98522407-7cc1-4844-8681-8116459faf79 could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:22.431635 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6ad5b937-dcd5-43c6-ba60-729cb590bd6e tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/98522407-7cc1-4844-8681-8116459faf79" status: 404 len: 109 microversion: 2.1 time: 0.046171 Jan 19 13:06:22.432501 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 198/382] 10.222.0.48 () {58 vars in 1244 bytes} [Wed Jan 19 13:06:22 2022] GET /compute/v2.1/os-volumes/98522407-7cc1-4844-8681-8116459faf79 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:06:22.443714 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e717ff0d-482e-4ae0-baff-328fecb44d69 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07e459fd30>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:22.474093 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-e717ff0d-482e-4ae0-baff-328fecb44d69 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] HTTP exception thrown: Volume 98522407-7cc1-4844-8681-8116459faf79 could not be found. Jan 19 13:06:22.474696 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e717ff0d-482e-4ae0-baff-328fecb44d69 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Returning 404 to user: Volume 98522407-7cc1-4844-8681-8116459faf79 could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:22.475640 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e717ff0d-482e-4ae0-baff-328fecb44d69 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/98522407-7cc1-4844-8681-8116459faf79" status: 404 len: 109 microversion: 2.1 time: 0.036807 Jan 19 13:06:22.477051 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 185/383] 10.222.0.48 () {58 vars in 1247 bytes} [Wed Jan 19 13:06:22 2022] DELETE /compute/v2.1/os-volumes/98522407-7cc1-4844-8681-8116459faf79 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:06:22.486974 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-139f0fb1-0d56-43f4-90ec-19088c3b4d47 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Calling method '.version_select at 0x7f07d7e13430>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:22.518388 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-139f0fb1-0d56-43f4-90ec-19088c3b4d47 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] HTTP exception thrown: Volume 98522407-7cc1-4844-8681-8116459faf79 could not be found. Jan 19 13:06:22.519717 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-139f0fb1-0d56-43f4-90ec-19088c3b4d47 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] Returning 404 to user: Volume 98522407-7cc1-4844-8681-8116459faf79 could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:22.520931 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-139f0fb1-0d56-43f4-90ec-19088c3b4d47 tempest-VolumesSnapshotsTestJSON-1612560377 tempest-VolumesSnapshotsTestJSON-1612560377-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/98522407-7cc1-4844-8681-8116459faf79" status: 404 len: 109 microversion: 2.1 time: 0.040505 Jan 19 13:06:22.521912 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 199/384] 10.222.0.48 () {58 vars in 1244 bytes} [Wed Jan 19 13:06:22 2022] GET /compute/v2.1/os-volumes/98522407-7cc1-4844-8681-8116459faf79 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:06:22.735358 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c8e9091b-0bb5-4be7-965e-de102322afea tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:22.736619 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c8e9091b-0bb5-4be7-965e-de102322afea tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:22.744671 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c8e9091b-0bb5-4be7-965e-de102322afea tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:22.745260 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c8e9091b-0bb5-4be7-965e-de102322afea tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:22.746165 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c8e9091b-0bb5-4be7-965e-de102322afea tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:22.746713 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c8e9091b-0bb5-4be7-965e-de102322afea tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:22.823958 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c8e9091b-0bb5-4be7-965e-de102322afea tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28193 microversion: 2.1 time: 0.094220 Jan 19 13:06:22.825123 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 186/385] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:22 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:23.313438 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d8dd07b4-1dbe-4f3b-bb68-ea2dc140ebac tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:23.314023 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d8dd07b4-1dbe-4f3b-bb68-ea2dc140ebac tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: 8cc6ff9a-b69e-4da7-b919-cfb76d90895c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:23.326264 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d8dd07b4-1dbe-4f3b-bb68-ea2dc140ebac tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:23.326733 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d8dd07b4-1dbe-4f3b-bb68-ea2dc140ebac tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:23.327700 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d8dd07b4-1dbe-4f3b-bb68-ea2dc140ebac tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:23.328268 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d8dd07b4-1dbe-4f3b-bb68-ea2dc140ebac tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:23.357945 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-d8dd07b4-1dbe-4f3b-bb68-ea2dc140ebac tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] HTTP exception thrown: Instance 8cc6ff9a-b69e-4da7-b919-cfb76d90895c could not be found. Jan 19 13:06:23.358545 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d8dd07b4-1dbe-4f3b-bb68-ea2dc140ebac tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Returning 404 to user: Instance 8cc6ff9a-b69e-4da7-b919-cfb76d90895c could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:23.359481 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d8dd07b4-1dbe-4f3b-bb68-ea2dc140ebac tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c" status: 404 len: 111 microversion: 2.1 time: 0.051519 Jan 19 13:06:23.360059 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 200/386] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:23 2022] GET /compute/v2.1/servers/8cc6ff9a-b69e-4da7-b919-cfb76d90895c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:06:23.402845 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-1d260ae9-e34d-4d0b-aeb8-8452ac9aa4a6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:23.404284 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-1d260ae9-e34d-4d0b-aeb8-8452ac9aa4a6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:23.408488 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a1b23205-e71b-4560-8900-6e3fff530624 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:23.409399 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a1b23205-e71b-4560-8900-6e3fff530624 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:23.413503 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1d260ae9-e34d-4d0b-aeb8-8452ac9aa4a6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:23.414204 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1d260ae9-e34d-4d0b-aeb8-8452ac9aa4a6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:23.415357 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1d260ae9-e34d-4d0b-aeb8-8452ac9aa4a6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:23.416513 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1d260ae9-e34d-4d0b-aeb8-8452ac9aa4a6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:23.417228 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a1b23205-e71b-4560-8900-6e3fff530624 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:23.417689 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a1b23205-e71b-4560-8900-6e3fff530624 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:23.418572 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a1b23205-e71b-4560-8900-6e3fff530624 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:23.419681 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a1b23205-e71b-4560-8900-6e3fff530624 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:23.492930 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a1b23205-e71b-4560-8900-6e3fff530624 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28167 microversion: 2.20 time: 0.087866 Jan 19 13:06:23.493630 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 201/387] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:23 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28167 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:06:23.568080 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-1d260ae9-e34d-4d0b-aeb8-8452ac9aa4a6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:23.575591 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-1d260ae9-e34d-4d0b-aeb8-8452ac9aa4a6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.180152 Jan 19 13:06:23.576170 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 187/388] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:23 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:23.610182 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2016341984", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452", "networks": [{"uuid": "fb2a0380-a969-49ba-a38e-e2e05cea65f5"}]}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:23.670928 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.network.neutron [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] validate_networks() for [('fb2a0380-a969-49ba-a38e-e2e05cea65f5', None, None, None, None, None)] {{(pid=116361) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:06:23.836273 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-662c29c9-17c1-4cf2-a2b0-d7885bb034ae tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:23.837329 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-662c29c9-17c1-4cf2-a2b0-d7885bb034ae tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:23.852681 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-662c29c9-17c1-4cf2-a2b0-d7885bb034ae tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:23.859408 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-662c29c9-17c1-4cf2-a2b0-d7885bb034ae tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:23.860347 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-662c29c9-17c1-4cf2-a2b0-d7885bb034ae tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:23.860808 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-662c29c9-17c1-4cf2-a2b0-d7885bb034ae tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:23.978029 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-662c29c9-17c1-4cf2-a2b0-d7885bb034ae tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28193 microversion: 2.1 time: 0.145408 Jan 19 13:06:23.978745 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 188/389] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:23 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28193 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:24.184937 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Flavor limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:06:24.185462 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Image limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:06:24.185928 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Flavor pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:06:24.186379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Image pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:06:24.187028 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:06:24.202268 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:24.203004 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:24.204591 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:24.205276 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:24.228699 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Getting quotas for project 167b7b3080be4152a08560f830129a97. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:06:24.233815 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Getting quotas for user 3cfb3a4a011445c493c301c51f7332ac and project 167b7b3080be4152a08560f830129a97. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:06:24.257797 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Going to run 1 instances... {{(pid=116361) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:06:24.261984 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:06:24.359262 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-210ef9b8-a559-44e3-8167-6490981d7e80 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752953 Jan 19 13:06:24.359917 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 202/390] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:06:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:06:24.370538 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-99d10012-16c8-43e4-9dab-ba02535929ad tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:24.371508 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-99d10012-16c8-43e4-9dab-ba02535929ad tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:24.494493 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-99d10012-16c8-43e4-9dab-ba02535929ad tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:24.505628 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-99d10012-16c8-43e4-9dab-ba02535929ad tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 200 len: 1214 microversion: 2.1 time: 0.138966 Jan 19 13:06:24.505816 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-05c16a60-3929-4ade-aeb2-1da87f0bc389 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:24.506206 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 189/391] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:24 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:24.506815 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-05c16a60-3929-4ade-aeb2-1da87f0bc389 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:24.522382 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05c16a60-3929-4ade-aeb2-1da87f0bc389 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:24.523291 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05c16a60-3929-4ade-aeb2-1da87f0bc389 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:24.527274 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05c16a60-3929-4ade-aeb2-1da87f0bc389 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:24.527816 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05c16a60-3929-4ade-aeb2-1da87f0bc389 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:24.593260 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-57442bb5-ecb4-4ee1-a6cf-e865c279a4ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:24.594024 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-57442bb5-ecb4-4ee1-a6cf-e865c279a4ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:24.602416 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-57442bb5-ecb4-4ee1-a6cf-e865c279a4ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:24.602899 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-57442bb5-ecb4-4ee1-a6cf-e865c279a4ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:24.612294 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-57442bb5-ecb4-4ee1-a6cf-e865c279a4ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:24.613398 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-57442bb5-ecb4-4ee1-a6cf-e865c279a4ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:24.639383 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-05c16a60-3929-4ade-aeb2-1da87f0bc389 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28167 microversion: 2.20 time: 0.138013 Jan 19 13:06:24.640336 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 203/392] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:24 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28167 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:06:24.869993 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-57442bb5-ecb4-4ee1-a6cf-e865c279a4ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:24.877634 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-57442bb5-ecb4-4ee1-a6cf-e865c279a4ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.288882 Jan 19 13:06:24.892416 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 190/393] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:24 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:06:24.992060 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-410a6e4f-adc0-4e5d-b5ce-8ce38dec2a72 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:24.993179 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-410a6e4f-adc0-4e5d-b5ce-8ce38dec2a72 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:25.001663 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-410a6e4f-adc0-4e5d-b5ce-8ce38dec2a72 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:25.002480 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-410a6e4f-adc0-4e5d-b5ce-8ce38dec2a72 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:25.003826 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-410a6e4f-adc0-4e5d-b5ce-8ce38dec2a72 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:25.004458 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-410a6e4f-adc0-4e5d-b5ce-8ce38dec2a72 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:25.111823 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-410a6e4f-adc0-4e5d-b5ce-8ce38dec2a72 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28193 microversion: 2.1 time: 0.123049 Jan 19 13:06:25.114766 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 191/394] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:24 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28193 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:25.261842 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f8975e87-5dba-4c0e-944d-d8b2da4b2ab4 tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] Action: 'create', calling method: .version_select at 0x7f07d7e33ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-267887093", "metadata": {"Type": "work"}}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:25.263849 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f8975e87-5dba-4c0e-944d-d8b2da4b2ab4 tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:25.265655 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f8975e87-5dba-4c0e-944d-d8b2da4b2ab4 tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.424647 Jan 19 13:06:25.266349 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 204/395] 10.222.0.48 () {60 vars in 1155 bytes} [Wed Jan 19 13:06:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 427 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 13:06:25.277982 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ba938db2-5b33-47a8-99df-3baefd337a70 tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] Action: 'create', calling method: .version_select at 0x7f07e470d790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1100391279", "metadata": {"Type": "work"}}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:25.279409 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ba938db2-5b33-47a8-99df-3baefd337a70 tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:25.280633 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ba938db2-5b33-47a8-99df-3baefd337a70 tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007208 Jan 19 13:06:25.286875 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 192/396] 10.222.0.48 () {60 vars in 1155 bytes} [Wed Jan 19 13:06:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 13:06:25.294566 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7d317abf-6a2f-48f0-83c0-964badaf25da tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] Action: 'create', calling method: .version_select at 0x7f07d7e08f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2067699745", "metadata": {"Type": "work"}}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:25.295874 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7d317abf-6a2f-48f0-83c0-964badaf25da tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:25.296793 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7d317abf-6a2f-48f0-83c0-964badaf25da tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007061 Jan 19 13:06:25.306994 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-141c7ba1-e624-4cdd-b320-7515309eb508 tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] Calling method '.version_select at 0x7f07e468d160>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:25.307310 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 205/397] 10.222.0.48 () {60 vars in 1155 bytes} [Wed Jan 19 13:06:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 13:06:25.341140 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-141c7ba1-e624-4cdd-b320-7515309eb508 tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] HTTP exception thrown: Volume tempest-invalid-987942950 could not be found. Jan 19 13:06:25.341868 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-141c7ba1-e624-4cdd-b320-7515309eb508 tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] Returning 404 to user: Volume tempest-invalid-987942950 could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:25.342964 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-141c7ba1-e624-4cdd-b320-7515309eb508 tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-987942950" status: 404 len: 98 microversion: 2.1 time: 0.039318 Jan 19 13:06:25.343694 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 193/398] 10.222.0.48 () {58 vars in 1214 bytes} [Wed Jan 19 13:06:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-987942950 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 19 13:06:25.355913 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-446d403b-12be-45f3-8122-4f83eecbc886 tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005377 Jan 19 13:06:25.356728 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 206/399] 10.222.0.48 () {58 vars in 1139 bytes} [Wed Jan 19 13:06:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 19 13:06:25.372777 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2d5a655c-d564-485b-a68e-03a915812b3c tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006742 Jan 19 13:06:25.373304 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 194/400] 10.222.0.48 () {58 vars in 1136 bytes} [Wed Jan 19 13:06:25 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 19 13:06:25.383144 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d5f78582-095c-4710-91b6-9160abf4194c tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] Calling method '.version_select at 0x7f07d7e133a0>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:25.423777 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-d5f78582-095c-4710-91b6-9160abf4194c tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] HTTP exception thrown: Volume 52299a70-859c-4932-afe5-70d5714b2666 could not be found. Jan 19 13:06:25.424392 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d5f78582-095c-4710-91b6-9160abf4194c tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] Returning 404 to user: Volume 52299a70-859c-4932-afe5-70d5714b2666 could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:25.425906 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d5f78582-095c-4710-91b6-9160abf4194c tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/52299a70-859c-4932-afe5-70d5714b2666" status: 404 len: 109 microversion: 2.1 time: 0.046513 Jan 19 13:06:25.426654 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 207/401] 10.222.0.48 () {58 vars in 1247 bytes} [Wed Jan 19 13:06:25 2022] DELETE /compute/v2.1/os-volumes/52299a70-859c-4932-afe5-70d5714b2666 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:06:25.438645 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f11b41a9-519e-42ec-b5d3-ef39cf3c5daf tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] Calling method '.version_select at 0x7f07e45d9310>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:25.474017 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-f11b41a9-519e-42ec-b5d3-ef39cf3c5daf tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] HTTP exception thrown: Volume 3548e9ec-e359-41ed-9bba-c199538a1551 could not be found. Jan 19 13:06:25.474628 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f11b41a9-519e-42ec-b5d3-ef39cf3c5daf tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] Returning 404 to user: Volume 3548e9ec-e359-41ed-9bba-c199538a1551 could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:25.476092 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f11b41a9-519e-42ec-b5d3-ef39cf3c5daf tempest-VolumesNegativeTest-1503294322 tempest-VolumesNegativeTest-1503294322-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/3548e9ec-e359-41ed-9bba-c199538a1551" status: 404 len: 109 microversion: 2.1 time: 0.042588 Jan 19 13:06:25.476810 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 195/402] 10.222.0.48 () {58 vars in 1244 bytes} [Wed Jan 19 13:06:25 2022] GET /compute/v2.1/os-volumes/3548e9ec-e359-41ed-9bba-c199538a1551 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:06:25.522885 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ba7b4660-371c-405e-806f-0fb6997ff9a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:25.523593 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ba7b4660-371c-405e-806f-0fb6997ff9a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:25.531576 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ba7b4660-371c-405e-806f-0fb6997ff9a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:25.534232 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ba7b4660-371c-405e-806f-0fb6997ff9a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:25.536739 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ba7b4660-371c-405e-806f-0fb6997ff9a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:25.537356 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ba7b4660-371c-405e-806f-0fb6997ff9a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:25.654001 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-557db1c4-430a-4823-907b-145b93d85341 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:25.655087 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-557db1c4-430a-4823-907b-145b93d85341 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:25.657667 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ba7b4660-371c-405e-806f-0fb6997ff9a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:25.672332 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-557db1c4-430a-4823-907b-145b93d85341 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:25.673661 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ba7b4660-371c-405e-806f-0fb6997ff9a8 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 200 len: 1266 microversion: 2.1 time: 0.154857 Jan 19 13:06:25.674535 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-557db1c4-430a-4823-907b-145b93d85341 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:25.677143 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-557db1c4-430a-4823-907b-145b93d85341 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:25.677253 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 208/403] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:25 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:25.677972 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-557db1c4-430a-4823-907b-145b93d85341 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:25.823453 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-557db1c4-430a-4823-907b-145b93d85341 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28167 microversion: 2.20 time: 0.175295 Jan 19 13:06:25.824402 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 196/404] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:25 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28167 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:25.901539 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9ee1f038-2f4f-48a1-9a6c-be29d8ef9610 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:25.902508 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9ee1f038-2f4f-48a1-9a6c-be29d8ef9610 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:25.914232 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9ee1f038-2f4f-48a1-9a6c-be29d8ef9610 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:25.914707 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9ee1f038-2f4f-48a1-9a6c-be29d8ef9610 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:25.915525 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9ee1f038-2f4f-48a1-9a6c-be29d8ef9610 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:25.919885 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9ee1f038-2f4f-48a1-9a6c-be29d8ef9610 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:26.127183 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-17e51bcf-e45f-4cb7-bed7-521c9fe59318 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:26.129311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-17e51bcf-e45f-4cb7-bed7-521c9fe59318 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:26.147295 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-17e51bcf-e45f-4cb7-bed7-521c9fe59318 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:26.147745 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-17e51bcf-e45f-4cb7-bed7-521c9fe59318 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:26.149854 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-17e51bcf-e45f-4cb7-bed7-521c9fe59318 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:26.150311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-17e51bcf-e45f-4cb7-bed7-521c9fe59318 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:26.310323 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-9ee1f038-2f4f-48a1-9a6c-be29d8ef9610 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:26.318516 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9ee1f038-2f4f-48a1-9a6c-be29d8ef9610 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.422600 Jan 19 13:06:26.321614 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 209/405] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:25 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:26.498384 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-17e51bcf-e45f-4cb7-bed7-521c9fe59318 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28193 microversion: 2.1 time: 0.371297 Jan 19 13:06:26.499093 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 197/406] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:26 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28193 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:26.690709 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-006bcb8c-c520-4f32-8612-9aa84c8fbc03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:26.691565 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-006bcb8c-c520-4f32-8612-9aa84c8fbc03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:26.699021 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-006bcb8c-c520-4f32-8612-9aa84c8fbc03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:26.699930 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-006bcb8c-c520-4f32-8612-9aa84c8fbc03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:26.700884 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-006bcb8c-c520-4f32-8612-9aa84c8fbc03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:26.701553 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-006bcb8c-c520-4f32-8612-9aa84c8fbc03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:26.837375 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3239aa74-17ad-45bd-b374-cea868a23ff9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:26.838588 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3239aa74-17ad-45bd-b374-cea868a23ff9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:26.856992 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3239aa74-17ad-45bd-b374-cea868a23ff9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:26.857587 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3239aa74-17ad-45bd-b374-cea868a23ff9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:26.865051 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3239aa74-17ad-45bd-b374-cea868a23ff9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:26.865680 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3239aa74-17ad-45bd-b374-cea868a23ff9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:26.902685 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-006bcb8c-c520-4f32-8612-9aa84c8fbc03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:26.924132 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-006bcb8c-c520-4f32-8612-9aa84c8fbc03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 200 len: 1272 microversion: 2.1 time: 0.226244 Jan 19 13:06:26.925113 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 210/407] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:26 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:26.952961 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3239aa74-17ad-45bd-b374-cea868a23ff9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28167 microversion: 2.20 time: 0.121286 Jan 19 13:06:26.954128 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 198/408] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:26 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28167 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:27.337790 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-05714862-7872-46af-8513-386c7722344e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:27.345700 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-05714862-7872-46af-8513-386c7722344e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:27.353457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05714862-7872-46af-8513-386c7722344e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:27.354125 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05714862-7872-46af-8513-386c7722344e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:27.355284 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05714862-7872-46af-8513-386c7722344e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:27.355878 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05714862-7872-46af-8513-386c7722344e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:27.509768 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-11ca242a-1c35-40a4-b46e-7a5e28fc3dd2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:27.513811 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-11ca242a-1c35-40a4-b46e-7a5e28fc3dd2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:27.537769 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-11ca242a-1c35-40a4-b46e-7a5e28fc3dd2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:27.538683 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-11ca242a-1c35-40a4-b46e-7a5e28fc3dd2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:27.542918 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-11ca242a-1c35-40a4-b46e-7a5e28fc3dd2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:27.544312 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-11ca242a-1c35-40a4-b46e-7a5e28fc3dd2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:27.656876 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-11ca242a-1c35-40a4-b46e-7a5e28fc3dd2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28193 microversion: 2.1 time: 0.154786 Jan 19 13:06:27.663341 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 199/409] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:27 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28193 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:27.925600 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-05714862-7872-46af-8513-386c7722344e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:27.943068 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-cf1c40ed-e195-47b4-a435-fb33f00adf6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:27.943891 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-cf1c40ed-e195-47b4-a435-fb33f00adf6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:27.955016 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-05714862-7872-46af-8513-386c7722344e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1522 microversion: 2.1 time: 0.619381 Jan 19 13:06:27.958300 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 211/410] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:27 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1522 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:27.971607 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf1c40ed-e195-47b4-a435-fb33f00adf6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:27.975562 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf1c40ed-e195-47b4-a435-fb33f00adf6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:27.976728 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf1c40ed-e195-47b4-a435-fb33f00adf6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:27.977173 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf1c40ed-e195-47b4-a435-fb33f00adf6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:27.980773 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7f10da35-b1e2-4a5a-b223-a8178ebcd4fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:27.981857 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7f10da35-b1e2-4a5a-b223-a8178ebcd4fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:28.006587 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f10da35-b1e2-4a5a-b223-a8178ebcd4fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:28.007038 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f10da35-b1e2-4a5a-b223-a8178ebcd4fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:28.007841 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f10da35-b1e2-4a5a-b223-a8178ebcd4fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:28.011247 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f10da35-b1e2-4a5a-b223-a8178ebcd4fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:28.165997 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7f10da35-b1e2-4a5a-b223-a8178ebcd4fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28167 microversion: 2.20 time: 0.195584 Jan 19 13:06:28.166979 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 212/411] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:27 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28167 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:28.500523 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-cf1c40ed-e195-47b4-a435-fb33f00adf6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:28.514367 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-cf1c40ed-e195-47b4-a435-fb33f00adf6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 200 len: 1314 microversion: 2.1 time: 0.576702 Jan 19 13:06:28.516321 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 200/412] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:27 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:06:28.670682 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-bb5b812e-e29b-4235-97df-f4144057a7f3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:28.672193 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-bb5b812e-e29b-4235-97df-f4144057a7f3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:28.688749 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bb5b812e-e29b-4235-97df-f4144057a7f3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:28.689356 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bb5b812e-e29b-4235-97df-f4144057a7f3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:28.690421 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bb5b812e-e29b-4235-97df-f4144057a7f3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:28.692828 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bb5b812e-e29b-4235-97df-f4144057a7f3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:28.794459 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-bb5b812e-e29b-4235-97df-f4144057a7f3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28193 microversion: 2.1 time: 0.127782 Jan 19 13:06:28.795936 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 213/413] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:28 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28193 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:28.882673 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-f271389a-74a4-4464-945f-ac919609e4dd req-69ce21ae-817d-478c-a38b-a98d267e56ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3b06afb-941f-4099-9b43-467e88292e39", "tag": "1b33b194-a8ec-4396-8b44-1788cec9854b"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:28.884921 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:06:28.884921 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:06:28.898536 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-f271389a-74a4-4464-945f-ac919609e4dd req-69ce21ae-817d-478c-a38b-a98d267e56ca service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:28.903184 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-f271389a-74a4-4464-945f-ac919609e4dd req-69ce21ae-817d-478c-a38b-a98d267e56ca service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:28.930886 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-f271389a-74a4-4464-945f-ac919609e4dd req-69ce21ae-817d-478c-a38b-a98d267e56ca service nova] Creating event network-changed:1b33b194-a8ec-4396-8b44-1788cec9854b for instance c3b06afb-941f-4099-9b43-467e88292e39 on hv-cinder-82301 Jan 19 13:06:28.941824 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-f271389a-74a4-4464-945f-ac919609e4dd req-69ce21ae-817d-478c-a38b-a98d267e56ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065630 Jan 19 13:06:28.944436 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 201/414] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:06:28.977364 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-68dc4615-786c-4e81-9924-73b6338235c1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:28.978263 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-68dc4615-786c-4e81-9924-73b6338235c1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:28.996465 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-68dc4615-786c-4e81-9924-73b6338235c1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:29.008665 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-68dc4615-786c-4e81-9924-73b6338235c1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:29.009717 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-68dc4615-786c-4e81-9924-73b6338235c1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:29.012780 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-68dc4615-786c-4e81-9924-73b6338235c1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:29.181979 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f9d933f6-e7b1-4961-bf97-15b8ac5d8ca7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:29.183400 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f9d933f6-e7b1-4961-bf97-15b8ac5d8ca7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:29.201154 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9d933f6-e7b1-4961-bf97-15b8ac5d8ca7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:29.201612 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9d933f6-e7b1-4961-bf97-15b8ac5d8ca7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:29.202416 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9d933f6-e7b1-4961-bf97-15b8ac5d8ca7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:29.202857 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9d933f6-e7b1-4961-bf97-15b8ac5d8ca7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:29.304912 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f9d933f6-e7b1-4961-bf97-15b8ac5d8ca7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28167 microversion: 2.20 time: 0.128619 Jan 19 13:06:29.305584 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 202/415] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:29 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28167 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:06:29.494073 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-68dc4615-786c-4e81-9924-73b6338235c1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:29.514426 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-68dc4615-786c-4e81-9924-73b6338235c1 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1502 microversion: 2.1 time: 0.539844 Jan 19 13:06:29.522648 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 214/416] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:28 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1502 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:29.536504 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-95523bc1-1ab0-4976-8882-7c4e5671834d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:29.537212 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-95523bc1-1ab0-4976-8882-7c4e5671834d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:29.539113 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b8030087-1194-410a-9a29-b9671613a55d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:29.539731 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b8030087-1194-410a-9a29-b9671613a55d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:29.554538 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8030087-1194-410a-9a29-b9671613a55d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:29.565464 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8030087-1194-410a-9a29-b9671613a55d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:29.567293 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-95523bc1-1ab0-4976-8882-7c4e5671834d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:29.567758 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-95523bc1-1ab0-4976-8882-7c4e5671834d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:29.568583 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-95523bc1-1ab0-4976-8882-7c4e5671834d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:29.568757 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8030087-1194-410a-9a29-b9671613a55d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:29.571271 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8030087-1194-410a-9a29-b9671613a55d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:29.574520 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-95523bc1-1ab0-4976-8882-7c4e5671834d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:30.498610 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-95523bc1-1ab0-4976-8882-7c4e5671834d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:30.507656 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-95523bc1-1ab0-4976-8882-7c4e5671834d tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 200 len: 1314 microversion: 2.1 time: 0.977287 Jan 19 13:06:30.525840 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 203/417] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:29 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 1314 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:30.531937 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e64661e3-e4b0-4054-a937-7733dce59ec5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:30.532912 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e64661e3-e4b0-4054-a937-7733dce59ec5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:30.545884 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e64661e3-e4b0-4054-a937-7733dce59ec5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:30.546346 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e64661e3-e4b0-4054-a937-7733dce59ec5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:30.547142 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e64661e3-e4b0-4054-a937-7733dce59ec5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:30.547581 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e64661e3-e4b0-4054-a937-7733dce59ec5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:30.588406 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b8030087-1194-410a-9a29-b9671613a55d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:30.598513 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b8030087-1194-410a-9a29-b9671613a55d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1515 microversion: 2.1 time: 1.063174 Jan 19 13:06:30.599103 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 215/418] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:29 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1515 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:30.621967 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e5dda0d6-c41c-4e1f-90c6-b3eb0e552dde tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:30.623021 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e5dda0d6-c41c-4e1f-90c6-b3eb0e552dde tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:30.640665 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e5dda0d6-c41c-4e1f-90c6-b3eb0e552dde tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:30.654675 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e5dda0d6-c41c-4e1f-90c6-b3eb0e552dde tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:30.656270 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e5dda0d6-c41c-4e1f-90c6-b3eb0e552dde tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:30.656733 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e5dda0d6-c41c-4e1f-90c6-b3eb0e552dde tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:30.678526 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e64661e3-e4b0-4054-a937-7733dce59ec5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28193 microversion: 2.1 time: 0.151402 Jan 19 13:06:30.679159 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 204/419] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:30 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28193 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:30.747462 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e5dda0d6-c41c-4e1f-90c6-b3eb0e552dde tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28167 microversion: 2.20 time: 0.144287 Jan 19 13:06:30.748169 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 216/420] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:30 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28167 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:31.527858 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-98703c04-887f-4a3c-81df-81d5aa3efcfc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:31.529154 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-98703c04-887f-4a3c-81df-81d5aa3efcfc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:31.543195 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-98703c04-887f-4a3c-81df-81d5aa3efcfc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:31.544728 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-98703c04-887f-4a3c-81df-81d5aa3efcfc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:31.546108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-98703c04-887f-4a3c-81df-81d5aa3efcfc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:31.552255 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-98703c04-887f-4a3c-81df-81d5aa3efcfc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:31.690041 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d7cb06cc-ceab-4030-a9f0-f1bb51d74865 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:31.692162 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d7cb06cc-ceab-4030-a9f0-f1bb51d74865 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:31.705154 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d7cb06cc-ceab-4030-a9f0-f1bb51d74865 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:31.705607 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d7cb06cc-ceab-4030-a9f0-f1bb51d74865 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:31.706663 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d7cb06cc-ceab-4030-a9f0-f1bb51d74865 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:31.707219 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d7cb06cc-ceab-4030-a9f0-f1bb51d74865 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:31.779630 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-98703c04-887f-4a3c-81df-81d5aa3efcfc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:31.796303 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-98703c04-887f-4a3c-81df-81d5aa3efcfc tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 200 len: 1314 microversion: 2.1 time: 0.272139 Jan 19 13:06:31.797396 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 205/421] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:31 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:31.810264 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-518abcc9-49cf-4ecc-85fd-b8edf1b50e38 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:31.812740 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-518abcc9-49cf-4ecc-85fd-b8edf1b50e38 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:31.813158 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d7cb06cc-ceab-4030-a9f0-f1bb51d74865 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28193 microversion: 2.1 time: 0.125011 Jan 19 13:06:31.813975 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 217/422] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:31 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28193 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:31.825749 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-518abcc9-49cf-4ecc-85fd-b8edf1b50e38 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:31.826519 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-518abcc9-49cf-4ecc-85fd-b8edf1b50e38 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:31.827529 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-518abcc9-49cf-4ecc-85fd-b8edf1b50e38 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:31.828199 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-518abcc9-49cf-4ecc-85fd-b8edf1b50e38 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:32.039851 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-518abcc9-49cf-4ecc-85fd-b8edf1b50e38 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28167 microversion: 2.20 time: 0.240233 Jan 19 13:06:32.040416 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 206/423] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:31 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28167 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:32.352986 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-53a1bdf4-6cba-4465-b5be-066302cade7d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:32.354113 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-53a1bdf4-6cba-4465-b5be-066302cade7d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:32.367230 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-53a1bdf4-6cba-4465-b5be-066302cade7d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:32.368548 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-53a1bdf4-6cba-4465-b5be-066302cade7d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:32.371076 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-53a1bdf4-6cba-4465-b5be-066302cade7d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:32.371525 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-53a1bdf4-6cba-4465-b5be-066302cade7d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:32.449084 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.objects.instance [None req-53a1bdf4-6cba-4465-b5be-066302cade7d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lazy-loading 'flavor' on Instance uuid 9b74c954-19e1-498d-a9b6-c0fb2663635a {{(pid=116361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:06:32.609374 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-53a1bdf4-6cba-4465-b5be-066302cade7d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "POST /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/action" status: 200 len: 32 microversion: 2.1 time: 0.261164 Jan 19 13:06:32.612136 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 218/424] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:32 2022] POST /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/action => generated 32 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:06:32.627045 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c0f927be-14f4-4da8-9026-b453e10ec3b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:32.629764 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c0f927be-14f4-4da8-9026-b453e10ec3b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:32.643255 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c0f927be-14f4-4da8-9026-b453e10ec3b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:32.647583 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c0f927be-14f4-4da8-9026-b453e10ec3b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:32.648620 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c0f927be-14f4-4da8-9026-b453e10ec3b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:32.651408 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c0f927be-14f4-4da8-9026-b453e10ec3b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:32.817299 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-18a25045-7121-4385-b563-47e1844a7e03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:32.818056 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-18a25045-7121-4385-b563-47e1844a7e03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:32.829422 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-18a25045-7121-4385-b563-47e1844a7e03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:32.830136 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-18a25045-7121-4385-b563-47e1844a7e03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:32.831713 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-18a25045-7121-4385-b563-47e1844a7e03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:32.832627 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-18a25045-7121-4385-b563-47e1844a7e03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:33.021481 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c0f927be-14f4-4da8-9026-b453e10ec3b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:33.032279 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c0f927be-14f4-4da8-9026-b453e10ec3b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 0.415210 Jan 19 13:06:33.032857 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 207/425] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:32 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:33.049311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4b826434-15e7-4940-a8ee-2b5c82379115 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:33.051201 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4b826434-15e7-4940-a8ee-2b5c82379115 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:33.063028 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4b826434-15e7-4940-a8ee-2b5c82379115 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:33.065336 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4b826434-15e7-4940-a8ee-2b5c82379115 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:33.067414 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4b826434-15e7-4940-a8ee-2b5c82379115 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:33.069327 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4b826434-15e7-4940-a8ee-2b5c82379115 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:33.191200 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4b826434-15e7-4940-a8ee-2b5c82379115 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28193 microversion: 2.1 time: 0.155526 Jan 19 13:06:33.191848 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 208/426] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:33 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28193 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:33.200888 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-97dc6140-9668-47e9-978d-77daf2e10d48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:33.204804 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-97dc6140-9668-47e9-978d-77daf2e10d48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:33.223022 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-97dc6140-9668-47e9-978d-77daf2e10d48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:33.225589 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-97dc6140-9668-47e9-978d-77daf2e10d48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:33.229528 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-97dc6140-9668-47e9-978d-77daf2e10d48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:33.231336 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-97dc6140-9668-47e9-978d-77daf2e10d48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:33.290333 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-18a25045-7121-4385-b563-47e1844a7e03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:33.316738 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-18a25045-7121-4385-b563-47e1844a7e03 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 200 len: 1314 microversion: 2.1 time: 0.505618 Jan 19 13:06:33.325818 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 219/427] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:32 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:33.360284 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-97dc6140-9668-47e9-978d-77daf2e10d48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28167 microversion: 2.20 time: 0.166531 Jan 19 13:06:33.365409 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 209/428] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:33 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28167 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:34.061357 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-742dbd3e-04d5-42ac-9ec2-6ce3637ef564 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:34.062062 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-742dbd3e-04d5-42ac-9ec2-6ce3637ef564 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:34.087706 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-742dbd3e-04d5-42ac-9ec2-6ce3637ef564 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:34.088199 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-742dbd3e-04d5-42ac-9ec2-6ce3637ef564 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:34.099057 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-742dbd3e-04d5-42ac-9ec2-6ce3637ef564 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:34.099545 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-742dbd3e-04d5-42ac-9ec2-6ce3637ef564 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:34.204205 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b0fed4a2-10b8-4fc1-81ee-80a7bfc6a56b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:34.205786 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b0fed4a2-10b8-4fc1-81ee-80a7bfc6a56b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:34.221842 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b0fed4a2-10b8-4fc1-81ee-80a7bfc6a56b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:34.235166 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b0fed4a2-10b8-4fc1-81ee-80a7bfc6a56b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:34.237730 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b0fed4a2-10b8-4fc1-81ee-80a7bfc6a56b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:34.242187 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b0fed4a2-10b8-4fc1-81ee-80a7bfc6a56b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:34.375079 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b0fed4a2-10b8-4fc1-81ee-80a7bfc6a56b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28320 microversion: 2.1 time: 0.175799 Jan 19 13:06:34.375742 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 210/429] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:34 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28320 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:34.394207 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-df37300d-b129-420d-b5db-e3abbb3cc275 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:34.394922 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-df37300d-b129-420d-b5db-e3abbb3cc275 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:34.429086 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-df37300d-b129-420d-b5db-e3abbb3cc275 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:34.429554 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-df37300d-b129-420d-b5db-e3abbb3cc275 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:34.432067 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-df37300d-b129-420d-b5db-e3abbb3cc275 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:34.434030 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-df37300d-b129-420d-b5db-e3abbb3cc275 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:34.498961 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-742dbd3e-04d5-42ac-9ec2-6ce3637ef564 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:34.517781 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-742dbd3e-04d5-42ac-9ec2-6ce3637ef564 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 0.471283 Jan 19 13:06:34.524066 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 220/430] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:34 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:34.530666 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-232f594f-f4c9-4ea2-ac38-9283a4ee5d74 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:34.542614 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-232f594f-f4c9-4ea2-ac38-9283a4ee5d74 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:34.563248 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-232f594f-f4c9-4ea2-ac38-9283a4ee5d74 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:34.563945 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-232f594f-f4c9-4ea2-ac38-9283a4ee5d74 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:34.566176 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-232f594f-f4c9-4ea2-ac38-9283a4ee5d74 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:34.567078 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-232f594f-f4c9-4ea2-ac38-9283a4ee5d74 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:34.696264 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-232f594f-f4c9-4ea2-ac38-9283a4ee5d74 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28458 microversion: 2.20 time: 0.170347 Jan 19 13:06:34.697208 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 221/431] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:34 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28458 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:35.003810 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-df37300d-b129-420d-b5db-e3abbb3cc275 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:35.014918 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-df37300d-b129-420d-b5db-e3abbb3cc275 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 200 len: 1314 microversion: 2.1 time: 0.631621 Jan 19 13:06:35.015663 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 211/432] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:34 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:35.391549 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-13ba52da-9392-4cff-83c9-2feab86c59a8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:35.408224 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-13ba52da-9392-4cff-83c9-2feab86c59a8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:35.423684 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13ba52da-9392-4cff-83c9-2feab86c59a8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:35.424576 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13ba52da-9392-4cff-83c9-2feab86c59a8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:35.426562 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13ba52da-9392-4cff-83c9-2feab86c59a8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:35.427166 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13ba52da-9392-4cff-83c9-2feab86c59a8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:35.544132 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-13ba52da-9392-4cff-83c9-2feab86c59a8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28484 microversion: 2.1 time: 0.158714 Jan 19 13:06:35.546116 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0c6bf7b1-b0d5-4781-aa67-65e81525204d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:35.546942 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 222/433] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:35 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28484 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:35.547784 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0c6bf7b1-b0d5-4781-aa67-65e81525204d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:35.559388 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0c6bf7b1-b0d5-4781-aa67-65e81525204d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:35.560695 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0c6bf7b1-b0d5-4781-aa67-65e81525204d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:35.562934 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0c6bf7b1-b0d5-4781-aa67-65e81525204d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:35.563731 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0c6bf7b1-b0d5-4781-aa67-65e81525204d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:35.715015 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5992862a-0627-4b34-b071-51051f288e2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:35.716266 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5992862a-0627-4b34-b071-51051f288e2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:35.730704 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5992862a-0627-4b34-b071-51051f288e2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:35.735482 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5992862a-0627-4b34-b071-51051f288e2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:35.738693 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5992862a-0627-4b34-b071-51051f288e2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:35.740199 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5992862a-0627-4b34-b071-51051f288e2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:35.874173 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5992862a-0627-4b34-b071-51051f288e2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.165541 Jan 19 13:06:35.875513 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 223/434] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:35 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:36.042780 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-61848189-505b-4e41-b1e3-9ab72d562915 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:36.044891 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-61848189-505b-4e41-b1e3-9ab72d562915 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:36.062630 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-61848189-505b-4e41-b1e3-9ab72d562915 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:36.063103 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-61848189-505b-4e41-b1e3-9ab72d562915 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:36.067707 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-61848189-505b-4e41-b1e3-9ab72d562915 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:36.068200 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-61848189-505b-4e41-b1e3-9ab72d562915 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:36.750925 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0c6bf7b1-b0d5-4781-aa67-65e81525204d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:36.752684 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-61848189-505b-4e41-b1e3-9ab72d562915 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:36.760283 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-61848189-505b-4e41-b1e3-9ab72d562915 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 200 len: 1314 microversion: 2.1 time: 0.729160 Jan 19 13:06:36.763542 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0c6bf7b1-b0d5-4781-aa67-65e81525204d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 1.230176 Jan 19 13:06:36.763761 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 224/435] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:36 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 1314 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:36.767419 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 212/436] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:35 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:36.772046 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-27e1b298-e12f-46b3-8903-18f0e41bf87f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:36.772956 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-27e1b298-e12f-46b3-8903-18f0e41bf87f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:36.794238 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27e1b298-e12f-46b3-8903-18f0e41bf87f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:36.800080 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27e1b298-e12f-46b3-8903-18f0e41bf87f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:36.801094 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27e1b298-e12f-46b3-8903-18f0e41bf87f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:36.808666 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27e1b298-e12f-46b3-8903-18f0e41bf87f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:36.890957 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c0ebc180-c961-47d2-b902-e9e603dce3eb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:36.890957 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c0ebc180-c961-47d2-b902-e9e603dce3eb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:36.903680 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c0ebc180-c961-47d2-b902-e9e603dce3eb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:36.904202 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c0ebc180-c961-47d2-b902-e9e603dce3eb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:36.905045 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c0ebc180-c961-47d2-b902-e9e603dce3eb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:36.905485 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c0ebc180-c961-47d2-b902-e9e603dce3eb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:36.918267 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-27e1b298-e12f-46b3-8903-18f0e41bf87f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.153088 Jan 19 13:06:36.918907 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 225/437] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:36 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:37.005618 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c0ebc180-c961-47d2-b902-e9e603dce3eb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.121758 Jan 19 13:06:37.006819 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 213/438] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:36 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:37.791886 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e3bb3ef0-dded-4787-9bb1-03b9b23f669f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:37.795734 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-edda65c2-d546-41aa-94a1-e0b4a2c30cfb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:37.796455 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-edda65c2-d546-41aa-94a1-e0b4a2c30cfb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:37.797847 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e3bb3ef0-dded-4787-9bb1-03b9b23f669f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:37.820912 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-edda65c2-d546-41aa-94a1-e0b4a2c30cfb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:37.823530 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3bb3ef0-dded-4787-9bb1-03b9b23f669f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:37.824071 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3bb3ef0-dded-4787-9bb1-03b9b23f669f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:37.826928 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-edda65c2-d546-41aa-94a1-e0b4a2c30cfb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:37.833751 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-edda65c2-d546-41aa-94a1-e0b4a2c30cfb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:37.834977 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3bb3ef0-dded-4787-9bb1-03b9b23f669f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:37.835591 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-edda65c2-d546-41aa-94a1-e0b4a2c30cfb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:37.837713 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3bb3ef0-dded-4787-9bb1-03b9b23f669f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:38.623298 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e3bb3ef0-dded-4787-9bb1-03b9b23f669f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:38.636850 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e3bb3ef0-dded-4787-9bb1-03b9b23f669f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 200 len: 1314 microversion: 2.1 time: 0.860168 Jan 19 13:06:38.637264 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-edda65c2-d546-41aa-94a1-e0b4a2c30cfb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:38.640253 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 226/439] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:37 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 1314 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:38.652321 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3aa9a1be-8d5b-44d2-956a-8c8ac95968c8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:38.653806 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3aa9a1be-8d5b-44d2-956a-8c8ac95968c8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:38.656555 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-edda65c2-d546-41aa-94a1-e0b4a2c30cfb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 0.871339 Jan 19 13:06:38.666351 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3aa9a1be-8d5b-44d2-956a-8c8ac95968c8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:38.667737 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3aa9a1be-8d5b-44d2-956a-8c8ac95968c8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:38.668986 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 214/440] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:37 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:38.669608 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3aa9a1be-8d5b-44d2-956a-8c8ac95968c8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:38.670257 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3aa9a1be-8d5b-44d2-956a-8c8ac95968c8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:38.676346 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-329c1b9b-0648-4980-9503-3663f27d6e2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:38.679845 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-329c1b9b-0648-4980-9503-3663f27d6e2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:38.695865 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-329c1b9b-0648-4980-9503-3663f27d6e2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:38.696576 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-329c1b9b-0648-4980-9503-3663f27d6e2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:38.697560 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-329c1b9b-0648-4980-9503-3663f27d6e2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:38.698152 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-329c1b9b-0648-4980-9503-3663f27d6e2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:38.799289 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3aa9a1be-8d5b-44d2-956a-8c8ac95968c8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.157102 Jan 19 13:06:38.801486 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 227/441] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:38 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:38.810164 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-e2b5d8b6-c264-4073-bba1-b814c7a0174c req-5091933b-35d7-467c-bc34-363ebe608ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b06afb-941f-4099-9b43-467e88292e39", "name": "network-vif-plugged", "status": "completed", "tag": "1b33b194-a8ec-4396-8b44-1788cec9854b"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:38.811137 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-329c1b9b-0648-4980-9503-3663f27d6e2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.140978 Jan 19 13:06:38.812444 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 215/442] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:38 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:38.817476 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:06:38.817476 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:06:38.828223 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-e2b5d8b6-c264-4073-bba1-b814c7a0174c req-5091933b-35d7-467c-bc34-363ebe608ac8 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:38.829318 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-e2b5d8b6-c264-4073-bba1-b814c7a0174c req-5091933b-35d7-467c-bc34-363ebe608ac8 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:38.873895 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-e2b5d8b6-c264-4073-bba1-b814c7a0174c req-5091933b-35d7-467c-bc34-363ebe608ac8 service nova] Creating event network-vif-plugged:1b33b194-a8ec-4396-8b44-1788cec9854b for instance c3b06afb-941f-4099-9b43-467e88292e39 on hv-cinder-82301 Jan 19 13:06:38.903322 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-e2b5d8b6-c264-4073-bba1-b814c7a0174c req-5091933b-35d7-467c-bc34-363ebe608ac8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098309 Jan 19 13:06:38.907631 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 228/443] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:06:39.660687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c08ad166-a60c-46c5-82cf-4715faf0656f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:39.661708 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c08ad166-a60c-46c5-82cf-4715faf0656f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:39.679629 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b51a9c8d-2615-441f-a4de-f054dd3c2afc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:39.679900 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c08ad166-a60c-46c5-82cf-4715faf0656f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:39.680550 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c08ad166-a60c-46c5-82cf-4715faf0656f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:39.681043 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b51a9c8d-2615-441f-a4de-f054dd3c2afc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:39.688467 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c08ad166-a60c-46c5-82cf-4715faf0656f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:39.689331 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c08ad166-a60c-46c5-82cf-4715faf0656f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:39.722038 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b51a9c8d-2615-441f-a4de-f054dd3c2afc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:39.723853 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b51a9c8d-2615-441f-a4de-f054dd3c2afc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:39.724927 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b51a9c8d-2615-441f-a4de-f054dd3c2afc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:39.725548 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b51a9c8d-2615-441f-a4de-f054dd3c2afc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:40.229317 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b51a9c8d-2615-441f-a4de-f054dd3c2afc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:40.266207 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b51a9c8d-2615-441f-a4de-f054dd3c2afc tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 0.591214 Jan 19 13:06:40.272323 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 229/444] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:39 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:40.278390 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c08ad166-a60c-46c5-82cf-4715faf0656f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:40.293758 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8a75a8ec-e65f-4567-a491-5cb1022f3356 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:40.294786 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8a75a8ec-e65f-4567-a491-5cb1022f3356 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:40.295559 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c08ad166-a60c-46c5-82cf-4715faf0656f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 200 len: 1314 microversion: 2.1 time: 0.640451 Jan 19 13:06:40.305912 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 216/445] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:39 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:40.311045 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d229d26e-6e12-4aec-a778-03a901bfdd6a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:40.311944 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d229d26e-6e12-4aec-a778-03a901bfdd6a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:40.336961 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d229d26e-6e12-4aec-a778-03a901bfdd6a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:40.337975 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d229d26e-6e12-4aec-a778-03a901bfdd6a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:40.338903 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d229d26e-6e12-4aec-a778-03a901bfdd6a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:40.339619 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d229d26e-6e12-4aec-a778-03a901bfdd6a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:40.344190 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8a75a8ec-e65f-4567-a491-5cb1022f3356 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:40.351582 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8a75a8ec-e65f-4567-a491-5cb1022f3356 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:40.359143 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8a75a8ec-e65f-4567-a491-5cb1022f3356 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:40.359603 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8a75a8ec-e65f-4567-a491-5cb1022f3356 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:40.433502 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d229d26e-6e12-4aec-a778-03a901bfdd6a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.126190 Jan 19 13:06:40.434926 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 217/446] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:40 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:40.498782 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8a75a8ec-e65f-4567-a491-5cb1022f3356 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.225101 Jan 19 13:06:40.499620 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 230/447] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:40 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:41.287172 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-35fa106e-2a5f-4ad6-8c13-9cb950b577cf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:41.289013 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-35fa106e-2a5f-4ad6-8c13-9cb950b577cf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:41.305640 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-35fa106e-2a5f-4ad6-8c13-9cb950b577cf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:41.306764 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-35fa106e-2a5f-4ad6-8c13-9cb950b577cf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:41.309368 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-35fa106e-2a5f-4ad6-8c13-9cb950b577cf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:41.310002 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-35fa106e-2a5f-4ad6-8c13-9cb950b577cf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:41.548706 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-35fa106e-2a5f-4ad6-8c13-9cb950b577cf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:41.567016 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2510f602-df90-4cf5-a3d0-4e6a7b51ae6e tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Action: 'create', calling method: .version_select at 0x7f07e4563430>, body: {"keypair": {"name": "tempest-TestShelveInstance-610852009"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:41.575794 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-35fa106e-2a5f-4ad6-8c13-9cb950b577cf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 0.296290 Jan 19 13:06:41.577751 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 231/448] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:41 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:41.582355 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-03c2b121-e916-4c1e-a1e5-7a91ff2deabe tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:41.582951 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-03c2b121-e916-4c1e-a1e5-7a91ff2deabe tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:41.597633 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-2510f602-df90-4cf5-a3d0-4e6a7b51ae6e tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Getting quotas for project d3cd5c7acaf1414c83c725421fc4f289. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:06:41.601838 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-2510f602-df90-4cf5-a3d0-4e6a7b51ae6e tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Getting quotas for user b78c8c1e6a2e47258c251260283d8314 and project d3cd5c7acaf1414c83c725421fc4f289. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:06:41.605139 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-03c2b121-e916-4c1e-a1e5-7a91ff2deabe tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:41.605623 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-03c2b121-e916-4c1e-a1e5-7a91ff2deabe tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:41.606447 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-03c2b121-e916-4c1e-a1e5-7a91ff2deabe tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:41.606887 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-03c2b121-e916-4c1e-a1e5-7a91ff2deabe tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:41.766097 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-03c2b121-e916-4c1e-a1e5-7a91ff2deabe tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:41.785308 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-03c2b121-e916-4c1e-a1e5-7a91ff2deabe tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 200 len: 1498 microversion: 2.1 time: 0.205375 Jan 19 13:06:41.786156 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 232/449] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:41 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 1498 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:41.801131 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-603bd986-227e-497f-af48-ca221e505d35 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:41.802857 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-603bd986-227e-497f-af48-ca221e505d35 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:41.811478 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-603bd986-227e-497f-af48-ca221e505d35 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:41.812568 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-603bd986-227e-497f-af48-ca221e505d35 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:41.813529 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-603bd986-227e-497f-af48-ca221e505d35 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:41.814123 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-603bd986-227e-497f-af48-ca221e505d35 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:41.854275 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-2510f602-df90-4cf5-a3d0-4e6a7b51ae6e tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Getting quotas for project d3cd5c7acaf1414c83c725421fc4f289. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:06:41.892295 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-2510f602-df90-4cf5-a3d0-4e6a7b51ae6e tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Getting quotas for user b78c8c1e6a2e47258c251260283d8314 and project d3cd5c7acaf1414c83c725421fc4f289. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:06:41.933255 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2510f602-df90-4cf5-a3d0-4e6a7b51ae6e tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.719893 Jan 19 13:06:41.934140 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-603bd986-227e-497f-af48-ca221e505d35 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.146610 Jan 19 13:06:41.934609 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 218/450] 10.222.0.48 () {60 vars in 1157 bytes} [Wed Jan 19 13:06:41 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:41.939066 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 233/451] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:41 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:41.943374 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-fe3f0742-1d0f-4ec7-ab79-f5406535f5d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:41.947748 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-fe3f0742-1d0f-4ec7-ab79-f5406535f5d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:41.963432 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fe3f0742-1d0f-4ec7-ab79-f5406535f5d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:41.965012 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fe3f0742-1d0f-4ec7-ab79-f5406535f5d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:41.966771 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fe3f0742-1d0f-4ec7-ab79-f5406535f5d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:41.967803 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fe3f0742-1d0f-4ec7-ab79-f5406535f5d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:42.100996 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-fe3f0742-1d0f-4ec7-ab79-f5406535f5d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.164780 Jan 19 13:06:42.102346 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 219/452] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:41 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:42.496393 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3c0be550-b826-4a1f-a150-ff41ffb50d6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:42.497625 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3c0be550-b826-4a1f-a150-ff41ffb50d6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:42.507753 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3c0be550-b826-4a1f-a150-ff41ffb50d6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:42.508497 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3c0be550-b826-4a1f-a150-ff41ffb50d6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:42.510550 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3c0be550-b826-4a1f-a150-ff41ffb50d6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:42.511239 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3c0be550-b826-4a1f-a150-ff41ffb50d6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:42.545415 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3c0be550-b826-4a1f-a150-ff41ffb50d6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Going to try to terminate instance {{(pid=116361) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:06:42.600538 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d504593d-89b7-422f-9f9e-9c25f156a9d3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:42.603549 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d504593d-89b7-422f-9f9e-9c25f156a9d3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:42.611089 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d504593d-89b7-422f-9f9e-9c25f156a9d3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:42.611714 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d504593d-89b7-422f-9f9e-9c25f156a9d3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:42.613086 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d504593d-89b7-422f-9f9e-9c25f156a9d3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:42.613814 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d504593d-89b7-422f-9f9e-9c25f156a9d3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:42.685291 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3c0be550-b826-4a1f-a150-ff41ffb50d6a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 204 len: 0 microversion: 2.1 time: 0.188123 Jan 19 13:06:42.686650 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 234/453] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:06:42 2022] DELETE /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:06:42.697457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e787bfd3-13f3-4ea3-b132-4cb2d556c83a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:42.698168 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e787bfd3-13f3-4ea3-b132-4cb2d556c83a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:42.715707 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e787bfd3-13f3-4ea3-b132-4cb2d556c83a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:42.716208 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e787bfd3-13f3-4ea3-b132-4cb2d556c83a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:42.717968 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e787bfd3-13f3-4ea3-b132-4cb2d556c83a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:42.718756 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e787bfd3-13f3-4ea3-b132-4cb2d556c83a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:43.029892 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d504593d-89b7-422f-9f9e-9c25f156a9d3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:43.041992 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d504593d-89b7-422f-9f9e-9c25f156a9d3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 0.446720 Jan 19 13:06:43.043832 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 220/454] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:42 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:06:43.052749 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-36cb21a8-0094-49cd-8f2b-accecf921d20 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:43.056480 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-36cb21a8-0094-49cd-8f2b-accecf921d20 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:43.078726 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-36cb21a8-0094-49cd-8f2b-accecf921d20 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:43.079194 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-36cb21a8-0094-49cd-8f2b-accecf921d20 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:43.080032 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-36cb21a8-0094-49cd-8f2b-accecf921d20 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:43.086476 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-36cb21a8-0094-49cd-8f2b-accecf921d20 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:43.097005 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e787bfd3-13f3-4ea3-b132-4cb2d556c83a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:43.107490 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e787bfd3-13f3-4ea3-b132-4cb2d556c83a tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 200 len: 1504 microversion: 2.1 time: 0.414886 Jan 19 13:06:43.110568 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 235/455] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:42 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 1504 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:43.136217 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-bcbeb19f-af29-475a-920f-32cfce0fc0fd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:43.139748 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-bcbeb19f-af29-475a-920f-32cfce0fc0fd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:43.180421 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bcbeb19f-af29-475a-920f-32cfce0fc0fd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:43.180872 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bcbeb19f-af29-475a-920f-32cfce0fc0fd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:43.187495 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bcbeb19f-af29-475a-920f-32cfce0fc0fd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:43.187960 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bcbeb19f-af29-475a-920f-32cfce0fc0fd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:43.191232 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-36cb21a8-0094-49cd-8f2b-accecf921d20 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.143650 Jan 19 13:06:43.192331 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 221/456] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:43 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:43.291832 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-bcbeb19f-af29-475a-920f-32cfce0fc0fd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.173523 Jan 19 13:06:43.294684 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 236/457] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:43 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:44.062030 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-db71cafc-e7c4-4f5c-9d5f-f5dcb0191b0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:44.062995 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-db71cafc-e7c4-4f5c-9d5f-f5dcb0191b0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:44.083659 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-db71cafc-e7c4-4f5c-9d5f-f5dcb0191b0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:44.088616 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-db71cafc-e7c4-4f5c-9d5f-f5dcb0191b0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:44.089581 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-db71cafc-e7c4-4f5c-9d5f-f5dcb0191b0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:44.090058 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-db71cafc-e7c4-4f5c-9d5f-f5dcb0191b0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:44.133225 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c5c20830-afa5-441d-b4b9-c169f349d440 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:44.134068 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c5c20830-afa5-441d-b4b9-c169f349d440 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:44.146379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5c20830-afa5-441d-b4b9-c169f349d440 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:44.147707 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5c20830-afa5-441d-b4b9-c169f349d440 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:44.148786 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5c20830-afa5-441d-b4b9-c169f349d440 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:44.149471 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5c20830-afa5-441d-b4b9-c169f349d440 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:44.464777 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-db71cafc-e7c4-4f5c-9d5f-f5dcb0191b0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:44.494685 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-db71cafc-e7c4-4f5c-9d5f-f5dcb0191b0c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 0.436954 Jan 19 13:06:44.508285 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 222/458] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:44 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:44.517741 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4f3122e6-c39b-44cf-8161-af64be6cdad9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:44.519522 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4f3122e6-c39b-44cf-8161-af64be6cdad9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:44.526437 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4f3122e6-c39b-44cf-8161-af64be6cdad9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:44.527091 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4f3122e6-c39b-44cf-8161-af64be6cdad9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:44.528360 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4f3122e6-c39b-44cf-8161-af64be6cdad9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:44.528944 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4f3122e6-c39b-44cf-8161-af64be6cdad9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:44.576527 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-c5c20830-afa5-441d-b4b9-c169f349d440 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:44.597747 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c5c20830-afa5-441d-b4b9-c169f349d440 tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 200 len: 1504 microversion: 2.1 time: 0.468539 Jan 19 13:06:44.615491 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 237/459] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:44 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 1504 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:44.618856 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4f3122e6-c39b-44cf-8161-af64be6cdad9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.107876 Jan 19 13:06:44.620277 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 223/460] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:44 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:44.621280 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f1664080-382c-4aa3-ae88-58ee142da156 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:44.622209 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f1664080-382c-4aa3-ae88-58ee142da156 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:44.641013 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f1664080-382c-4aa3-ae88-58ee142da156 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:44.641472 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f1664080-382c-4aa3-ae88-58ee142da156 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:44.642274 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f1664080-382c-4aa3-ae88-58ee142da156 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:44.642716 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f1664080-382c-4aa3-ae88-58ee142da156 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:44.740638 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f1664080-382c-4aa3-ae88-58ee142da156 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.123146 Jan 19 13:06:44.741363 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 238/461] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:44 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:45.406073 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-caa15554-95f1-4745-bd38-a3e84ab488d0 req-74197996-7789-4016-ae99-626931a4f4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b06afb-941f-4099-9b43-467e88292e39", "name": "network-vif-deleted", "tag": "1b33b194-a8ec-4396-8b44-1788cec9854b"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:45.413070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:06:45.413070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:06:45.442029 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-caa15554-95f1-4745-bd38-a3e84ab488d0 req-74197996-7789-4016-ae99-626931a4f4aa service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:45.442485 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-caa15554-95f1-4745-bd38-a3e84ab488d0 req-74197996-7789-4016-ae99-626931a4f4aa service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:45.457714 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-caa15554-95f1-4745-bd38-a3e84ab488d0 req-74197996-7789-4016-ae99-626931a4f4aa service nova] Creating event network-vif-deleted:1b33b194-a8ec-4396-8b44-1788cec9854b for instance c3b06afb-941f-4099-9b43-467e88292e39 on hv-cinder-82301 Jan 19 13:06:45.462662 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-caa15554-95f1-4745-bd38-a3e84ab488d0 req-74197996-7789-4016-ae99-626931a4f4aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063749 Jan 19 13:06:45.464146 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 224/462] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:06:45.528321 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-06fe9f0f-c6db-4d21-95cd-b86c8ed6f77d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:45.531913 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-06fe9f0f-c6db-4d21-95cd-b86c8ed6f77d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:45.544345 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-06fe9f0f-c6db-4d21-95cd-b86c8ed6f77d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:45.544794 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-06fe9f0f-c6db-4d21-95cd-b86c8ed6f77d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:45.545591 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-06fe9f0f-c6db-4d21-95cd-b86c8ed6f77d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:45.546029 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-06fe9f0f-c6db-4d21-95cd-b86c8ed6f77d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:45.617378 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-34b4e45c-0f5f-4d61-bf93-aef9ed0749fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:45.618431 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-34b4e45c-0f5f-4d61-bf93-aef9ed0749fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:45.625814 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-34b4e45c-0f5f-4d61-bf93-aef9ed0749fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:45.628646 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-34b4e45c-0f5f-4d61-bf93-aef9ed0749fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:45.629633 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-34b4e45c-0f5f-4d61-bf93-aef9ed0749fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:45.630281 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-34b4e45c-0f5f-4d61-bf93-aef9ed0749fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:45.688424 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-34b4e45c-0f5f-4d61-bf93-aef9ed0749fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:45.688996 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-34b4e45c-0f5f-4d61-bf93-aef9ed0749fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:45.689563 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.objects.instance [None req-34b4e45c-0f5f-4d61-bf93-aef9ed0749fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lazy-loading 'fault' on Instance uuid c3b06afb-941f-4099-9b43-467e88292e39 {{(pid=116360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:06:45.778192 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-34b4e45c-0f5f-4d61-bf93-aef9ed0749fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb3a4a011445c493c301c51f7332ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167b7b3080be4152a08560f830129a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:45.786079 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-34b4e45c-0f5f-4d61-bf93-aef9ed0749fd tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 200 len: 1304 microversion: 2.1 time: 0.173932 Jan 19 13:06:45.796065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 225/463] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:45 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 1304 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:45.796065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d9e9f22f-b3d6-4312-bc14-6650d2efe413 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:45.796065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d9e9f22f-b3d6-4312-bc14-6650d2efe413 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:45.802643 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d9e9f22f-b3d6-4312-bc14-6650d2efe413 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:45.803092 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d9e9f22f-b3d6-4312-bc14-6650d2efe413 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:45.803903 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d9e9f22f-b3d6-4312-bc14-6650d2efe413 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:45.804459 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d9e9f22f-b3d6-4312-bc14-6650d2efe413 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:45.825913 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-06fe9f0f-c6db-4d21-95cd-b86c8ed6f77d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:45.835159 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-06fe9f0f-c6db-4d21-95cd-b86c8ed6f77d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 0.324031 Jan 19 13:06:45.836148 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 239/464] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:45 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:45.848702 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ffcf8be9-b494-4a1d-9efc-72f4654f13bb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:45.849947 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ffcf8be9-b494-4a1d-9efc-72f4654f13bb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:45.858220 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ffcf8be9-b494-4a1d-9efc-72f4654f13bb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:45.858780 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ffcf8be9-b494-4a1d-9efc-72f4654f13bb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:45.859944 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ffcf8be9-b494-4a1d-9efc-72f4654f13bb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:45.862770 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ffcf8be9-b494-4a1d-9efc-72f4654f13bb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:45.916635 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d9e9f22f-b3d6-4312-bc14-6650d2efe413 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.128080 Jan 19 13:06:45.920675 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 226/465] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:45 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:45.966085 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ffcf8be9-b494-4a1d-9efc-72f4654f13bb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.128112 Jan 19 13:06:45.984130 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 240/466] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:45 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:46.807057 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e96b6fdf-f5ed-4168-a2d4-73bae6d60f1f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:46.807770 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e96b6fdf-f5ed-4168-a2d4-73bae6d60f1f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] [instance: c3b06afb-941f-4099-9b43-467e88292e39] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:46.817465 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e96b6fdf-f5ed-4168-a2d4-73bae6d60f1f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:46.817913 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e96b6fdf-f5ed-4168-a2d4-73bae6d60f1f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:46.818719 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e96b6fdf-f5ed-4168-a2d4-73bae6d60f1f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:46.819311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e96b6fdf-f5ed-4168-a2d4-73bae6d60f1f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:46.834845 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-e96b6fdf-f5ed-4168-a2d4-73bae6d60f1f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] HTTP exception thrown: Instance c3b06afb-941f-4099-9b43-467e88292e39 could not be found. Jan 19 13:06:46.835646 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e96b6fdf-f5ed-4168-a2d4-73bae6d60f1f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] Returning 404 to user: Instance c3b06afb-941f-4099-9b43-467e88292e39 could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:46.836435 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e96b6fdf-f5ed-4168-a2d4-73bae6d60f1f tempest-VolumesActionsTest-390797915 tempest-VolumesActionsTest-390797915-project] 10.222.0.48 "GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39" status: 404 len: 111 microversion: 2.1 time: 0.036925 Jan 19 13:06:46.837098 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 227/467] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:46 2022] GET /compute/v2.1/servers/c3b06afb-941f-4099-9b43-467e88292e39 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:06:46.855517 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b8483bb6-caa1-4339-9dbf-46fabebf214d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:46.856334 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b8483bb6-caa1-4339-9dbf-46fabebf214d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:46.866060 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8483bb6-caa1-4339-9dbf-46fabebf214d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:46.866518 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8483bb6-caa1-4339-9dbf-46fabebf214d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:46.867856 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8483bb6-caa1-4339-9dbf-46fabebf214d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:46.867856 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8483bb6-caa1-4339-9dbf-46fabebf214d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:46.932014 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3d902445-0df3-4243-b9fe-53a94540e67d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:46.933425 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3d902445-0df3-4243-b9fe-53a94540e67d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:46.941156 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3d902445-0df3-4243-b9fe-53a94540e67d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:46.941616 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3d902445-0df3-4243-b9fe-53a94540e67d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:46.942603 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3d902445-0df3-4243-b9fe-53a94540e67d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:46.943045 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3d902445-0df3-4243-b9fe-53a94540e67d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:47.053894 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3d902445-0df3-4243-b9fe-53a94540e67d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.128663 Jan 19 13:06:47.054944 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 228/468] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:46 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:47.062435 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2d8ab5d8-eda8-4f74-b05e-17febf5b204c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:47.063455 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2d8ab5d8-eda8-4f74-b05e-17febf5b204c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:47.070817 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b8483bb6-caa1-4339-9dbf-46fabebf214d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:47.076411 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2d8ab5d8-eda8-4f74-b05e-17febf5b204c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:47.076864 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2d8ab5d8-eda8-4f74-b05e-17febf5b204c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:47.079690 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b8483bb6-caa1-4339-9dbf-46fabebf214d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 0.228010 Jan 19 13:06:47.081407 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 241/469] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:46 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:47.086909 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2d8ab5d8-eda8-4f74-b05e-17febf5b204c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:47.090208 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2d8ab5d8-eda8-4f74-b05e-17febf5b204c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:47.164865 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2d8ab5d8-eda8-4f74-b05e-17febf5b204c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.108225 Jan 19 13:06:47.168033 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 229/470] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:47 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:48.067326 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-efcbdc2d-2db1-42a5-88b4-64aae21f4f22 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:48.069397 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-efcbdc2d-2db1-42a5-88b4-64aae21f4f22 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:48.077148 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-efcbdc2d-2db1-42a5-88b4-64aae21f4f22 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:48.077753 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-efcbdc2d-2db1-42a5-88b4-64aae21f4f22 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:48.078886 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-efcbdc2d-2db1-42a5-88b4-64aae21f4f22 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:48.079334 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-efcbdc2d-2db1-42a5-88b4-64aae21f4f22 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:48.100937 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-aef8c10c-c0f4-4f83-b4ff-1513bce8a6c0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:48.101639 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-aef8c10c-c0f4-4f83-b4ff-1513bce8a6c0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:48.109241 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aef8c10c-c0f4-4f83-b4ff-1513bce8a6c0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:48.109698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aef8c10c-c0f4-4f83-b4ff-1513bce8a6c0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:48.110778 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aef8c10c-c0f4-4f83-b4ff-1513bce8a6c0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:48.111140 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aef8c10c-c0f4-4f83-b4ff-1513bce8a6c0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:48.173095 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-efcbdc2d-2db1-42a5-88b4-64aae21f4f22 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.110720 Jan 19 13:06:48.174457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 242/471] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:48 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:48.182530 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c3c0b6bc-7b06-4426-ae45-c2e562e3408b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:48.183553 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c3c0b6bc-7b06-4426-ae45-c2e562e3408b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:48.195043 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c3c0b6bc-7b06-4426-ae45-c2e562e3408b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:48.195494 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c3c0b6bc-7b06-4426-ae45-c2e562e3408b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:48.196509 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c3c0b6bc-7b06-4426-ae45-c2e562e3408b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:48.197105 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c3c0b6bc-7b06-4426-ae45-c2e562e3408b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:48.265898 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c3c0b6bc-7b06-4426-ae45-c2e562e3408b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.090598 Jan 19 13:06:48.267545 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 243/472] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:48 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:48.271960 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-aef8c10c-c0f4-4f83-b4ff-1513bce8a6c0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:48.279395 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-aef8c10c-c0f4-4f83-b4ff-1513bce8a6c0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1501 microversion: 2.1 time: 0.183698 Jan 19 13:06:48.279943 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 230/473] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:48 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:48.296796 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-36b73345-0c8a-47bb-85e5-30102ee41316 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce3c96c3-a723-45e0-9f08-83a6d804baef"}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:48.297928 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-36b73345-0c8a-47bb-85e5-30102ee41316 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:48.305030 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-36b73345-0c8a-47bb-85e5-30102ee41316 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:48.305588 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-36b73345-0c8a-47bb-85e5-30102ee41316 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:48.306457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-36b73345-0c8a-47bb-85e5-30102ee41316 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:48.306970 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-36b73345-0c8a-47bb-85e5-30102ee41316 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:48.335074 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-36b73345-0c8a-47bb-85e5-30102ee41316 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] HTTP exception thrown: Cannot 'attach_volume' instance 9b74c954-19e1-498d-a9b6-c0fb2663635a while it is in vm_state rescued Jan 19 13:06:48.335668 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-36b73345-0c8a-47bb-85e5-30102ee41316 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Returning 409 to user: Cannot 'attach_volume' instance 9b74c954-19e1-498d-a9b6-c0fb2663635a while it is in vm_state rescued {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:06:48.336530 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-36b73345-0c8a-47bb-85e5-30102ee41316 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "POST /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043894 Jan 19 13:06:48.337237 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 244/474] 10.222.0.48 () {60 vars in 1322 bytes} [Wed Jan 19 13:06:48 2022] POST /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 19 13:06:48.345961 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-47c79c49-eaf6-47c9-8690-632d56e68c7e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:48.347240 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-47c79c49-eaf6-47c9-8690-632d56e68c7e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:48.353480 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-47c79c49-eaf6-47c9-8690-632d56e68c7e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:48.354097 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-47c79c49-eaf6-47c9-8690-632d56e68c7e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:48.355058 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-47c79c49-eaf6-47c9-8690-632d56e68c7e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:48.355488 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-47c79c49-eaf6-47c9-8690-632d56e68c7e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:48.425329 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-47c79c49-eaf6-47c9-8690-632d56e68c7e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "POST /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/action" status: 202 len: 0 microversion: 2.1 time: 0.082280 Jan 19 13:06:48.425957 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 231/475] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:48 2022] POST /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:48.435736 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8546443b-ed19-49bf-b1d2-3d29c4cb1454 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:48.436512 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8546443b-ed19-49bf-b1d2-3d29c4cb1454 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:48.443848 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8546443b-ed19-49bf-b1d2-3d29c4cb1454 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:48.444418 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8546443b-ed19-49bf-b1d2-3d29c4cb1454 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:48.445547 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8546443b-ed19-49bf-b1d2-3d29c4cb1454 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:48.446238 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8546443b-ed19-49bf-b1d2-3d29c4cb1454 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:48.614627 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-8546443b-ed19-49bf-b1d2-3d29c4cb1454 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:48.622213 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8546443b-ed19-49bf-b1d2-3d29c4cb1454 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1509 microversion: 2.1 time: 0.190702 Jan 19 13:06:48.622769 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 245/476] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:48 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:49.186615 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b6a38733-6c45-4433-b563-a07230354bd1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:49.188663 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b6a38733-6c45-4433-b563-a07230354bd1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:49.196446 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b6a38733-6c45-4433-b563-a07230354bd1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:49.197220 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b6a38733-6c45-4433-b563-a07230354bd1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:49.198338 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b6a38733-6c45-4433-b563-a07230354bd1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:49.199205 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b6a38733-6c45-4433-b563-a07230354bd1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:49.277746 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-86366b05-eba2-4ff9-ba63-019af6075156 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:49.278655 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-86366b05-eba2-4ff9-ba63-019af6075156 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:49.284923 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-86366b05-eba2-4ff9-ba63-019af6075156 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:49.285367 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-86366b05-eba2-4ff9-ba63-019af6075156 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:49.286139 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-86366b05-eba2-4ff9-ba63-019af6075156 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:49.286567 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-86366b05-eba2-4ff9-ba63-019af6075156 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:52.248117 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-86366b05-eba2-4ff9-ba63-019af6075156 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 2.973769 Jan 19 13:06:52.248776 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 246/477] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:49 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 2975 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:52.253741 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-273a863f-d683-45ae-8879-059454dd78e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:52.254455 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-273a863f-d683-45ae-8879-059454dd78e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:52.261244 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-273a863f-d683-45ae-8879-059454dd78e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:52.261756 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-273a863f-d683-45ae-8879-059454dd78e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:52.262816 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-273a863f-d683-45ae-8879-059454dd78e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:52.263255 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-273a863f-d683-45ae-8879-059454dd78e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:52.394967 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-273a863f-d683-45ae-8879-059454dd78e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:52.402761 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-273a863f-d683-45ae-8879-059454dd78e4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1509 microversion: 2.1 time: 0.152907 Jan 19 13:06:52.403326 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 247/478] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:52 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:53.259789 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-cd415822-c09f-4980-90e1-17b29236eada tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:53.260732 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-cd415822-c09f-4980-90e1-17b29236eada tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:53.267247 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cd415822-c09f-4980-90e1-17b29236eada tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:53.267699 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cd415822-c09f-4980-90e1-17b29236eada tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:53.269122 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cd415822-c09f-4980-90e1-17b29236eada tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:53.269557 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cd415822-c09f-4980-90e1-17b29236eada tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:53.617715 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b6a38733-6c45-4433-b563-a07230354bd1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 4.435960 Jan 19 13:06:53.618513 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 232/479] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:49 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 4438 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:53.623580 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a400eafc-f6c9-4d7e-9adf-38bfd1755d09 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:53.624300 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a400eafc-f6c9-4d7e-9adf-38bfd1755d09 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:53.631711 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a400eafc-f6c9-4d7e-9adf-38bfd1755d09 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:53.632170 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a400eafc-f6c9-4d7e-9adf-38bfd1755d09 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:53.632946 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a400eafc-f6c9-4d7e-9adf-38bfd1755d09 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:53.633670 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a400eafc-f6c9-4d7e-9adf-38bfd1755d09 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:53.659142 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-cd415822-c09f-4980-90e1-17b29236eada tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.402740 Jan 19 13:06:53.660100 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 248/480] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:53 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:53.860487 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a400eafc-f6c9-4d7e-9adf-38bfd1755d09 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:53.869769 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a400eafc-f6c9-4d7e-9adf-38bfd1755d09 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1509 microversion: 2.1 time: 0.249913 Jan 19 13:06:53.870500 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 233/481] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:53 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:54.629828 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-59b471cd-9c11-4fa8-b7d4-d09ce26c5fec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:54.630864 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-59b471cd-9c11-4fa8-b7d4-d09ce26c5fec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:54.638104 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-59b471cd-9c11-4fa8-b7d4-d09ce26c5fec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:54.638559 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-59b471cd-9c11-4fa8-b7d4-d09ce26c5fec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:54.639344 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-59b471cd-9c11-4fa8-b7d4-d09ce26c5fec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:54.639781 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-59b471cd-9c11-4fa8-b7d4-d09ce26c5fec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:54.670557 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-767ceb3f-9922-4689-a4cc-63dc87c26579 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:54.671478 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-767ceb3f-9922-4689-a4cc-63dc87c26579 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:54.678372 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-767ceb3f-9922-4689-a4cc-63dc87c26579 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:54.678826 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-767ceb3f-9922-4689-a4cc-63dc87c26579 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:54.679606 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-767ceb3f-9922-4689-a4cc-63dc87c26579 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:54.680085 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-767ceb3f-9922-4689-a4cc-63dc87c26579 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:54.804844 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-59b471cd-9c11-4fa8-b7d4-d09ce26c5fec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.178645 Jan 19 13:06:54.805411 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 249/482] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:54 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:06:54.817202 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-767ceb3f-9922-4689-a4cc-63dc87c26579 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.150131 Jan 19 13:06:54.817854 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 234/483] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:54 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:54.887305 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ac96d1c4-34df-42e5-be0d-3601bad3b929 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:54.888189 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ac96d1c4-34df-42e5-be0d-3601bad3b929 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:54.895571 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ac96d1c4-34df-42e5-be0d-3601bad3b929 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:54.896045 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ac96d1c4-34df-42e5-be0d-3601bad3b929 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:54.896858 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ac96d1c4-34df-42e5-be0d-3601bad3b929 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:54.897296 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ac96d1c4-34df-42e5-be0d-3601bad3b929 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:55.034331 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ac96d1c4-34df-42e5-be0d-3601bad3b929 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:55.044430 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ac96d1c4-34df-42e5-be0d-3601bad3b929 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1509 microversion: 2.1 time: 0.161412 Jan 19 13:06:55.045001 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 250/484] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:54 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:55.817432 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9c7d34fb-33b0-4e3e-9b84-5162e8a052af tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:55.818579 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9c7d34fb-33b0-4e3e-9b84-5162e8a052af tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:55.825657 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9c7d34fb-33b0-4e3e-9b84-5162e8a052af tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:55.826180 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9c7d34fb-33b0-4e3e-9b84-5162e8a052af tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:55.827054 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9c7d34fb-33b0-4e3e-9b84-5162e8a052af tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:55.827537 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9c7d34fb-33b0-4e3e-9b84-5162e8a052af tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:55.829046 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8f067323-3e4e-44c0-bb46-4026f558ead6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:55.830097 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8f067323-3e4e-44c0-bb46-4026f558ead6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:55.837376 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8f067323-3e4e-44c0-bb46-4026f558ead6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:55.837821 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8f067323-3e4e-44c0-bb46-4026f558ead6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:55.838607 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8f067323-3e4e-44c0-bb46-4026f558ead6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:55.839052 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8f067323-3e4e-44c0-bb46-4026f558ead6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:55.907956 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9c7d34fb-33b0-4e3e-9b84-5162e8a052af tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.094671 Jan 19 13:06:55.909900 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 235/485] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:55 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:55.911865 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8f067323-3e4e-44c0-bb46-4026f558ead6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.086715 Jan 19 13:06:55.912551 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 251/486] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:55 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:56.062383 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-cf140825-b4ce-405c-9882-ba03c2b0bc8b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:56.063108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-cf140825-b4ce-405c-9882-ba03c2b0bc8b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:56.071222 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf140825-b4ce-405c-9882-ba03c2b0bc8b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:56.071681 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf140825-b4ce-405c-9882-ba03c2b0bc8b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:56.072501 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf140825-b4ce-405c-9882-ba03c2b0bc8b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:56.072946 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cf140825-b4ce-405c-9882-ba03c2b0bc8b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:56.231598 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-cf140825-b4ce-405c-9882-ba03c2b0bc8b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:56.242259 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-cf140825-b4ce-405c-9882-ba03c2b0bc8b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1509 microversion: 2.1 time: 0.183949 Jan 19 13:06:56.247395 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 236/487] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:56 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:06:56.924603 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-8cc35195-7a24-4d91-b6d0-d4d45171fb09 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:56.925440 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8c74bc82-ab33-439e-a9a8-8e9c223939ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:56.925852 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8c74bc82-ab33-439e-a9a8-8e9c223939ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:56.926974 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-8cc35195-7a24-4d91-b6d0-d4d45171fb09 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:56.937907 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8cc35195-7a24-4d91-b6d0-d4d45171fb09 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:56.938320 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8cc35195-7a24-4d91-b6d0-d4d45171fb09 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:56.939520 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8cc35195-7a24-4d91-b6d0-d4d45171fb09 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:56.940819 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c74bc82-ab33-439e-a9a8-8e9c223939ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:56.941391 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8cc35195-7a24-4d91-b6d0-d4d45171fb09 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:56.941961 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c74bc82-ab33-439e-a9a8-8e9c223939ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:56.942812 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c74bc82-ab33-439e-a9a8-8e9c223939ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:56.943258 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c74bc82-ab33-439e-a9a8-8e9c223939ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:57.096010 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8c74bc82-ab33-439e-a9a8-8e9c223939ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.175863 Jan 19 13:06:57.097453 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 252/488] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:56 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:57.139041 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-8cc35195-7a24-4d91-b6d0-d4d45171fb09 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.218499 Jan 19 13:06:57.139928 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 237/489] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:56 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:57.266351 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-afe380d3-93d5-48e5-a68a-ee10f2015a8c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:57.267182 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-afe380d3-93d5-48e5-a68a-ee10f2015a8c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:57.274449 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-afe380d3-93d5-48e5-a68a-ee10f2015a8c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:57.274904 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-afe380d3-93d5-48e5-a68a-ee10f2015a8c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:57.275743 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-afe380d3-93d5-48e5-a68a-ee10f2015a8c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:57.276177 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-afe380d3-93d5-48e5-a68a-ee10f2015a8c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:57.421561 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-afe380d3-93d5-48e5-a68a-ee10f2015a8c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:06:57.429584 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-afe380d3-93d5-48e5-a68a-ee10f2015a8c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1515 microversion: 2.1 time: 0.167850 Jan 19 13:06:57.430147 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 253/490] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:57 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:06:58.108803 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-aa966ce4-83b5-45c2-a6ad-4b88979ab415 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:58.109813 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-aa966ce4-83b5-45c2-a6ad-4b88979ab415 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:58.117521 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa966ce4-83b5-45c2-a6ad-4b88979ab415 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:58.117968 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa966ce4-83b5-45c2-a6ad-4b88979ab415 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:58.118731 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa966ce4-83b5-45c2-a6ad-4b88979ab415 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:58.119164 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa966ce4-83b5-45c2-a6ad-4b88979ab415 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:58.150770 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b6f1ce14-5e72-4ff2-b9c0-e728a60d5f18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:58.151808 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b6f1ce14-5e72-4ff2-b9c0-e728a60d5f18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:58.158122 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b6f1ce14-5e72-4ff2-b9c0-e728a60d5f18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:58.159090 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b6f1ce14-5e72-4ff2-b9c0-e728a60d5f18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:58.159869 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b6f1ce14-5e72-4ff2-b9c0-e728a60d5f18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:58.160332 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b6f1ce14-5e72-4ff2-b9c0-e728a60d5f18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:58.180184 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-aa966ce4-83b5-45c2-a6ad-4b88979ab415 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.075197 Jan 19 13:06:58.184081 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 238/491] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:58 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:06:58.233560 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b6f1ce14-5e72-4ff2-b9c0-e728a60d5f18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.086459 Jan 19 13:06:58.238377 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 254/492] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:58 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:06:59.193573 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f43c3ba2-137b-4bf4-9250-012e0c2a53ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:59.194593 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f43c3ba2-137b-4bf4-9250-012e0c2a53ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:59.201792 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f43c3ba2-137b-4bf4-9250-012e0c2a53ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:59.202246 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f43c3ba2-137b-4bf4-9250-012e0c2a53ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:59.203035 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f43c3ba2-137b-4bf4-9250-012e0c2a53ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:59.203471 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f43c3ba2-137b-4bf4-9250-012e0c2a53ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:59.248912 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4c867eb2-d0a5-48a1-8c14-d7f0380bac37 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:06:59.251497 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4c867eb2-d0a5-48a1-8c14-d7f0380bac37 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:59.259105 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4c867eb2-d0a5-48a1-8c14-d7f0380bac37 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:59.259800 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4c867eb2-d0a5-48a1-8c14-d7f0380bac37 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:59.260635 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4c867eb2-d0a5-48a1-8c14-d7f0380bac37 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:59.261077 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4c867eb2-d0a5-48a1-8c14-d7f0380bac37 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:59.271108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f43c3ba2-137b-4bf4-9250-012e0c2a53ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.082748 Jan 19 13:06:59.275189 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 239/493] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:06:59 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:06:59.365792 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4c867eb2-d0a5-48a1-8c14-d7f0380bac37 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.122478 Jan 19 13:06:59.366771 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 255/494] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:06:59 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:06:59.899279 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2e329d83-c015-4516-a037-e72957aec41e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:06:59.900076 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2e329d83-c015-4516-a037-e72957aec41e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:06:59.907285 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2e329d83-c015-4516-a037-e72957aec41e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:59.907950 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2e329d83-c015-4516-a037-e72957aec41e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:06:59.909407 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2e329d83-c015-4516-a037-e72957aec41e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:06:59.909842 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2e329d83-c015-4516-a037-e72957aec41e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:00.065898 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2e329d83-c015-4516-a037-e72957aec41e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:00.074202 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2e329d83-c015-4516-a037-e72957aec41e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1515 microversion: 2.1 time: 0.178960 Jan 19 13:07:00.075313 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 240/495] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:06:59 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:00.091421 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-822b11e2-f48b-4742-acbb-5117a76227e2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "903d8736-7abf-4e95-95cc-d3ef8a9777ff"}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:00.092625 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-822b11e2-f48b-4742-acbb-5117a76227e2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:00.101146 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-822b11e2-f48b-4742-acbb-5117a76227e2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:00.101548 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-822b11e2-f48b-4742-acbb-5117a76227e2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:00.102354 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-822b11e2-f48b-4742-acbb-5117a76227e2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:00.102799 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-822b11e2-f48b-4742-acbb-5117a76227e2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:00.288219 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-fed66df3-f0a3-4e99-9586-f55d3563f87a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:00.288219 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-fed66df3-f0a3-4e99-9586-f55d3563f87a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:00.295307 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fed66df3-f0a3-4e99-9586-f55d3563f87a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:00.295764 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fed66df3-f0a3-4e99-9586-f55d3563f87a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:00.296586 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fed66df3-f0a3-4e99-9586-f55d3563f87a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:00.297264 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fed66df3-f0a3-4e99-9586-f55d3563f87a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:00.393620 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-fed66df3-f0a3-4e99-9586-f55d3563f87a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.111792 Jan 19 13:07:00.395238 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 241/496] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:00 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:00.400882 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d643ccbd-417f-4c09-a17a-d1e1e462e7cc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:00.406884 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d643ccbd-417f-4c09-a17a-d1e1e462e7cc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:00.415905 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d643ccbd-417f-4c09-a17a-d1e1e462e7cc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:00.416579 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d643ccbd-417f-4c09-a17a-d1e1e462e7cc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:00.417603 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d643ccbd-417f-4c09-a17a-d1e1e462e7cc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:00.418211 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d643ccbd-417f-4c09-a17a-d1e1e462e7cc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:00.486690 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d643ccbd-417f-4c09-a17a-d1e1e462e7cc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.088547 Jan 19 13:07:00.488149 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 242/497] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:00 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:00.513960 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-822b11e2-f48b-4742-acbb-5117a76227e2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "POST /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426760 Jan 19 13:07:00.515236 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 256/498] 10.222.0.48 () {60 vars in 1322 bytes} [Wed Jan 19 13:07:00 2022] POST /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:07:01.406546 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f5abfec9-f905-4b8d-9933-980ed0f2aa1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:01.407545 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f5abfec9-f905-4b8d-9933-980ed0f2aa1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:01.415802 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f5abfec9-f905-4b8d-9933-980ed0f2aa1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:01.416513 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f5abfec9-f905-4b8d-9933-980ed0f2aa1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:01.417457 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f5abfec9-f905-4b8d-9933-980ed0f2aa1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:01.418040 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f5abfec9-f905-4b8d-9933-980ed0f2aa1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:01.502781 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f5abfec9-f905-4b8d-9933-980ed0f2aa1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.099782 Jan 19 13:07:01.508031 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 243/499] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:01 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:01.520426 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3eebe6a3-6ea5-4662-b284-aaf5e3600cf4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:01.522935 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3eebe6a3-6ea5-4662-b284-aaf5e3600cf4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:01.530900 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3eebe6a3-6ea5-4662-b284-aaf5e3600cf4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:01.531632 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3eebe6a3-6ea5-4662-b284-aaf5e3600cf4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:01.532887 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3eebe6a3-6ea5-4662-b284-aaf5e3600cf4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:01.534905 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3eebe6a3-6ea5-4662-b284-aaf5e3600cf4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:01.602166 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3eebe6a3-6ea5-4662-b284-aaf5e3600cf4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.104154 Jan 19 13:07:01.603253 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 257/500] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:01 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:07:02.515305 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-89589c61-99c6-49dd-9200-c083268d56ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:02.517041 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-89589c61-99c6-49dd-9200-c083268d56ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:02.525126 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-89589c61-99c6-49dd-9200-c083268d56ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:02.525576 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-89589c61-99c6-49dd-9200-c083268d56ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:02.526607 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-89589c61-99c6-49dd-9200-c083268d56ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:02.527085 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-89589c61-99c6-49dd-9200-c083268d56ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:02.599469 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-89589c61-99c6-49dd-9200-c083268d56ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.088250 Jan 19 13:07:02.600164 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 244/501] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:02 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:02.616091 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9aa333a7-5116-4b43-94a2-3bd18352a08a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:02.617923 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9aa333a7-5116-4b43-94a2-3bd18352a08a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:02.625367 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9aa333a7-5116-4b43-94a2-3bd18352a08a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:02.626026 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9aa333a7-5116-4b43-94a2-3bd18352a08a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:02.627030 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9aa333a7-5116-4b43-94a2-3bd18352a08a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:02.628452 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9aa333a7-5116-4b43-94a2-3bd18352a08a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:02.701878 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9aa333a7-5116-4b43-94a2-3bd18352a08a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.091292 Jan 19 13:07:02.702716 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 258/502] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:02 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:03.611135 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a337bb7c-5bb4-4afb-988f-be471fb5a231 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:03.612756 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a337bb7c-5bb4-4afb-988f-be471fb5a231 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:03.619457 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a337bb7c-5bb4-4afb-988f-be471fb5a231 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:03.619904 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a337bb7c-5bb4-4afb-988f-be471fb5a231 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:03.620695 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a337bb7c-5bb4-4afb-988f-be471fb5a231 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:03.621129 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a337bb7c-5bb4-4afb-988f-be471fb5a231 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:03.688416 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a337bb7c-5bb4-4afb-988f-be471fb5a231 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.081058 Jan 19 13:07:03.689731 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 245/503] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:03 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:07:03.722032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-cf6c1791-cbe5-4254-af91-6320bfc924f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:03.722032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-cf6c1791-cbe5-4254-af91-6320bfc924f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:03.724991 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cf6c1791-cbe5-4254-af91-6320bfc924f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:03.725754 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cf6c1791-cbe5-4254-af91-6320bfc924f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:03.727133 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cf6c1791-cbe5-4254-af91-6320bfc924f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:03.727891 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cf6c1791-cbe5-4254-af91-6320bfc924f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:03.848188 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-cf6c1791-cbe5-4254-af91-6320bfc924f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.136722 Jan 19 13:07:03.848899 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 259/504] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:03 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:04.702300 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4c99d66a-fb33-4f34-a795-4604aeec474c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:04.703810 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4c99d66a-fb33-4f34-a795-4604aeec474c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:04.713373 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c99d66a-fb33-4f34-a795-4604aeec474c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:04.713832 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c99d66a-fb33-4f34-a795-4604aeec474c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:04.714618 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c99d66a-fb33-4f34-a795-4604aeec474c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:04.715060 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c99d66a-fb33-4f34-a795-4604aeec474c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:04.800777 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4c99d66a-fb33-4f34-a795-4604aeec474c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.103287 Jan 19 13:07:04.802121 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 246/505] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:04 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:04.866710 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-30461c82-df11-4085-8d94-e25dfa65cf64 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:04.867730 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-30461c82-df11-4085-8d94-e25dfa65cf64 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:04.881623 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-30461c82-df11-4085-8d94-e25dfa65cf64 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:04.882186 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-30461c82-df11-4085-8d94-e25dfa65cf64 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:04.883802 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-30461c82-df11-4085-8d94-e25dfa65cf64 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:04.884923 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-30461c82-df11-4085-8d94-e25dfa65cf64 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:04.986671 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-30461c82-df11-4085-8d94-e25dfa65cf64 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.127352 Jan 19 13:07:04.987438 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 260/506] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:04 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:05.813158 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6243a565-cc18-4511-ac0c-7baa7de4b657 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:05.814070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6243a565-cc18-4511-ac0c-7baa7de4b657 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:05.821767 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6243a565-cc18-4511-ac0c-7baa7de4b657 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:05.822415 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6243a565-cc18-4511-ac0c-7baa7de4b657 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:05.823362 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6243a565-cc18-4511-ac0c-7baa7de4b657 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:05.823933 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6243a565-cc18-4511-ac0c-7baa7de4b657 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:05.904156 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6243a565-cc18-4511-ac0c-7baa7de4b657 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.094621 Jan 19 13:07:05.912238 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 247/507] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:05 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:05.999910 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1c0db695-38ac-47ce-9f11-3322272f7ccc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:06.001043 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1c0db695-38ac-47ce-9f11-3322272f7ccc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:06.015100 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1c0db695-38ac-47ce-9f11-3322272f7ccc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:06.015956 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1c0db695-38ac-47ce-9f11-3322272f7ccc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:06.016918 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1c0db695-38ac-47ce-9f11-3322272f7ccc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:06.017448 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1c0db695-38ac-47ce-9f11-3322272f7ccc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:06.096126 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1c0db695-38ac-47ce-9f11-3322272f7ccc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.099938 Jan 19 13:07:06.101024 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 261/508] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:05 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:07:06.921302 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-19b03608-814f-4287-88be-baa73415bc8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:06.922394 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-19b03608-814f-4287-88be-baa73415bc8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:06.931608 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-19b03608-814f-4287-88be-baa73415bc8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:06.932086 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-19b03608-814f-4287-88be-baa73415bc8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:06.932888 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-19b03608-814f-4287-88be-baa73415bc8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:06.933332 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-19b03608-814f-4287-88be-baa73415bc8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:07.020088 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-19b03608-814f-4287-88be-baa73415bc8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.104212 Jan 19 13:07:07.020886 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 248/509] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:06 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:07.108906 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1bcdb1b0-74db-440f-bf9f-1e6eb889b997 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:07.111010 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1bcdb1b0-74db-440f-bf9f-1e6eb889b997 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:07.119383 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1bcdb1b0-74db-440f-bf9f-1e6eb889b997 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:07.120215 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1bcdb1b0-74db-440f-bf9f-1e6eb889b997 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:07.121239 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1bcdb1b0-74db-440f-bf9f-1e6eb889b997 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:07.121910 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1bcdb1b0-74db-440f-bf9f-1e6eb889b997 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:07.193872 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1bcdb1b0-74db-440f-bf9f-1e6eb889b997 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.089394 Jan 19 13:07:07.194954 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 262/510] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:07 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:08.035313 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a0141ea4-1b47-4603-afcb-1bb8e1054adb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:08.038458 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a0141ea4-1b47-4603-afcb-1bb8e1054adb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:08.057754 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a0141ea4-1b47-4603-afcb-1bb8e1054adb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:08.058813 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a0141ea4-1b47-4603-afcb-1bb8e1054adb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:08.060050 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a0141ea4-1b47-4603-afcb-1bb8e1054adb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:08.060761 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a0141ea4-1b47-4603-afcb-1bb8e1054adb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:08.157005 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a0141ea4-1b47-4603-afcb-1bb8e1054adb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.127374 Jan 19 13:07:08.158108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 249/511] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:08 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:08.205687 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d1bf2808-b02f-475d-be0d-77b9146667c7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:08.208334 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d1bf2808-b02f-475d-be0d-77b9146667c7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:08.223023 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d1bf2808-b02f-475d-be0d-77b9146667c7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:08.224203 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d1bf2808-b02f-475d-be0d-77b9146667c7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:08.227448 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d1bf2808-b02f-475d-be0d-77b9146667c7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:08.227942 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d1bf2808-b02f-475d-be0d-77b9146667c7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:08.327402 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d1bf2808-b02f-475d-be0d-77b9146667c7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.126094 Jan 19 13:07:08.328879 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 263/512] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:08 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:09.172638 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f12b8ac2-07ee-47e8-9b1c-a91d417490c3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:09.174620 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f12b8ac2-07ee-47e8-9b1c-a91d417490c3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:09.185992 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f12b8ac2-07ee-47e8-9b1c-a91d417490c3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:09.186839 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f12b8ac2-07ee-47e8-9b1c-a91d417490c3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:09.187751 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f12b8ac2-07ee-47e8-9b1c-a91d417490c3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:09.188847 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f12b8ac2-07ee-47e8-9b1c-a91d417490c3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:09.272941 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f12b8ac2-07ee-47e8-9b1c-a91d417490c3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.106746 Jan 19 13:07:09.273698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 250/513] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:09 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:09.339175 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d3d96687-1f5f-4f7b-b408-5d7e5a91ea61 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:09.340453 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d3d96687-1f5f-4f7b-b408-5d7e5a91ea61 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:09.347933 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d3d96687-1f5f-4f7b-b408-5d7e5a91ea61 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:09.348759 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d3d96687-1f5f-4f7b-b408-5d7e5a91ea61 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:09.349670 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d3d96687-1f5f-4f7b-b408-5d7e5a91ea61 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:09.350499 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d3d96687-1f5f-4f7b-b408-5d7e5a91ea61 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:09.422727 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d3d96687-1f5f-4f7b-b408-5d7e5a91ea61 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.087114 Jan 19 13:07:09.429679 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 264/514] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:09 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:10.290270 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-115e1ea6-749d-40f6-9d96-a9d8f2d9dded tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:10.291327 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-115e1ea6-749d-40f6-9d96-a9d8f2d9dded tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:10.298563 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-115e1ea6-749d-40f6-9d96-a9d8f2d9dded tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:10.299175 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-115e1ea6-749d-40f6-9d96-a9d8f2d9dded tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:10.301234 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-115e1ea6-749d-40f6-9d96-a9d8f2d9dded tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:10.301849 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-115e1ea6-749d-40f6-9d96-a9d8f2d9dded tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:10.394392 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-115e1ea6-749d-40f6-9d96-a9d8f2d9dded tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.110732 Jan 19 13:07:10.395289 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 251/515] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:10 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:10.442469 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-25575288-c7f3-4953-9375-85335961f168 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:10.444938 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-25575288-c7f3-4953-9375-85335961f168 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:10.485154 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-25575288-c7f3-4953-9375-85335961f168 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:10.488343 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-25575288-c7f3-4953-9375-85335961f168 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:10.495781 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-25575288-c7f3-4953-9375-85335961f168 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:10.496470 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-25575288-c7f3-4953-9375-85335961f168 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:10.603727 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-25575288-c7f3-4953-9375-85335961f168 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.163932 Jan 19 13:07:10.604694 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 265/516] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:10 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:11.391930 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e5414dda-b5cd-40f1-ba75-877ae540b205 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:11.393018 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e5414dda-b5cd-40f1-ba75-877ae540b205 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:11.407847 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b03ef931-a20f-41d2-a162-fee3feea6a08 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:11.409379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b03ef931-a20f-41d2-a162-fee3feea6a08 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:11.413501 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e5414dda-b5cd-40f1-ba75-877ae540b205 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:11.414236 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e5414dda-b5cd-40f1-ba75-877ae540b205 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:11.416578 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e5414dda-b5cd-40f1-ba75-877ae540b205 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:11.417778 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e5414dda-b5cd-40f1-ba75-877ae540b205 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:11.429496 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b03ef931-a20f-41d2-a162-fee3feea6a08 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:11.430189 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b03ef931-a20f-41d2-a162-fee3feea6a08 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:11.442660 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b03ef931-a20f-41d2-a162-fee3feea6a08 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:11.443230 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b03ef931-a20f-41d2-a162-fee3feea6a08 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:11.475630 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.objects.instance [None req-e5414dda-b5cd-40f1-ba75-877ae540b205 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lazy-loading 'flavor' on Instance uuid 9b74c954-19e1-498d-a9b6-c0fb2663635a {{(pid=116360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:07:11.705472 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e5414dda-b5cd-40f1-ba75-877ae540b205 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "POST /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/action" status: 200 len: 32 microversion: 2.1 time: 0.317595 Jan 19 13:07:11.714959 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 252/517] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:11 2022] POST /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/action => generated 32 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:07:11.728803 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-65fdef4b-7d53-4d3c-aeae-80156b9bee47 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:11.731446 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-65fdef4b-7d53-4d3c-aeae-80156b9bee47 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:11.751206 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-65fdef4b-7d53-4d3c-aeae-80156b9bee47 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:11.752388 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-65fdef4b-7d53-4d3c-aeae-80156b9bee47 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:11.753541 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-65fdef4b-7d53-4d3c-aeae-80156b9bee47 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:11.754415 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-65fdef4b-7d53-4d3c-aeae-80156b9bee47 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:15.517403 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b03ef931-a20f-41d2-a162-fee3feea6a08 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 4.113877 Jan 19 13:07:15.520833 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 266/518] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:11 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 4116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:07:15.523931 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-90389dd7-750c-4ca7-a6fa-a0bb1bdc3c79 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:15.524683 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-90389dd7-750c-4ca7-a6fa-a0bb1bdc3c79 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:15.527564 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-65fdef4b-7d53-4d3c-aeae-80156b9bee47 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 3.803787 Jan 19 13:07:15.532999 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 253/519] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:11 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 3817 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:15.533869 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-90389dd7-750c-4ca7-a6fa-a0bb1bdc3c79 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:15.534492 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-90389dd7-750c-4ca7-a6fa-a0bb1bdc3c79 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:15.535482 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-90389dd7-750c-4ca7-a6fa-a0bb1bdc3c79 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:15.536120 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-90389dd7-750c-4ca7-a6fa-a0bb1bdc3c79 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:15.986647 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-90389dd7-750c-4ca7-a6fa-a0bb1bdc3c79 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:15.994767 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-90389dd7-750c-4ca7-a6fa-a0bb1bdc3c79 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.475408 Jan 19 13:07:15.995339 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 267/520] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:15 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:16.530174 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-590e75d4-d4b8-4b42-9036-b734931cfdbe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:16.531205 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-590e75d4-d4b8-4b42-9036-b734931cfdbe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:16.539670 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-590e75d4-d4b8-4b42-9036-b734931cfdbe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:16.540090 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-590e75d4-d4b8-4b42-9036-b734931cfdbe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:16.540872 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-590e75d4-d4b8-4b42-9036-b734931cfdbe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:16.541636 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-590e75d4-d4b8-4b42-9036-b734931cfdbe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:16.544542 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7f9a3fcd-eacb-4d58-981c-bc06a40a6b57 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:16.545472 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7f9a3fcd-eacb-4d58-981c-bc06a40a6b57 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:16.553488 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f9a3fcd-eacb-4d58-981c-bc06a40a6b57 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:16.553944 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f9a3fcd-eacb-4d58-981c-bc06a40a6b57 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:16.554737 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f9a3fcd-eacb-4d58-981c-bc06a40a6b57 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:16.555180 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f9a3fcd-eacb-4d58-981c-bc06a40a6b57 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:16.644987 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-590e75d4-d4b8-4b42-9036-b734931cfdbe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.119209 Jan 19 13:07:16.648759 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 254/521] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:16 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:16.660798 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7f9a3fcd-eacb-4d58-981c-bc06a40a6b57 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.120099 Jan 19 13:07:16.665047 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 268/522] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:16 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:07:17.012743 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-420b9559-8309-41c2-b0e3-58716b06bfce tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:17.013439 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-420b9559-8309-41c2-b0e3-58716b06bfce tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:17.021040 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-420b9559-8309-41c2-b0e3-58716b06bfce tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:17.021500 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-420b9559-8309-41c2-b0e3-58716b06bfce tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:17.022302 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-420b9559-8309-41c2-b0e3-58716b06bfce tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:17.022742 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-420b9559-8309-41c2-b0e3-58716b06bfce tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:17.221206 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-420b9559-8309-41c2-b0e3-58716b06bfce tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:17.229666 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-420b9559-8309-41c2-b0e3-58716b06bfce tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.221253 Jan 19 13:07:17.239921 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 255/523] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:17 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:17.660410 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-389dead1-24bc-4cd5-8457-f3351ff486ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:17.661560 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-389dead1-24bc-4cd5-8457-f3351ff486ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:17.669613 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-389dead1-24bc-4cd5-8457-f3351ff486ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:17.670282 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-389dead1-24bc-4cd5-8457-f3351ff486ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:17.671262 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-389dead1-24bc-4cd5-8457-f3351ff486ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:17.671500 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-389dead1-24bc-4cd5-8457-f3351ff486ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:17.674056 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-76bef20e-acf0-4360-a311-d31d4099bfff tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:17.676253 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-76bef20e-acf0-4360-a311-d31d4099bfff tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:17.684823 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-76bef20e-acf0-4360-a311-d31d4099bfff tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:17.685311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-76bef20e-acf0-4360-a311-d31d4099bfff tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:17.686405 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-76bef20e-acf0-4360-a311-d31d4099bfff tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:17.686956 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-76bef20e-acf0-4360-a311-d31d4099bfff tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:17.748893 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-389dead1-24bc-4cd5-8457-f3351ff486ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.094653 Jan 19 13:07:17.749834 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 269/524] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:17 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:17.770317 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-76bef20e-acf0-4360-a311-d31d4099bfff tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.101488 Jan 19 13:07:17.771425 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 256/525] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:17 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:07:18.246983 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-eb9e89f0-09d9-4f82-8e46-5390a43ea998 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:18.247676 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-eb9e89f0-09d9-4f82-8e46-5390a43ea998 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:18.254924 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb9e89f0-09d9-4f82-8e46-5390a43ea998 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:18.255402 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb9e89f0-09d9-4f82-8e46-5390a43ea998 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:18.256221 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb9e89f0-09d9-4f82-8e46-5390a43ea998 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:18.256685 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb9e89f0-09d9-4f82-8e46-5390a43ea998 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:18.402969 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-eb9e89f0-09d9-4f82-8e46-5390a43ea998 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:18.411630 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-eb9e89f0-09d9-4f82-8e46-5390a43ea998 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.168749 Jan 19 13:07:18.412483 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 270/526] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:18 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:18.761785 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-525977ca-574b-4ca0-a11b-1a0614914e6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:18.762807 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-525977ca-574b-4ca0-a11b-1a0614914e6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:18.776661 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-525977ca-574b-4ca0-a11b-1a0614914e6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:18.777116 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-525977ca-574b-4ca0-a11b-1a0614914e6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:18.777904 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-525977ca-574b-4ca0-a11b-1a0614914e6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:18.782174 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-525977ca-574b-4ca0-a11b-1a0614914e6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:18.783066 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-05cf0ff1-efba-443f-80ad-1aaffcef4ab8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:18.784721 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-05cf0ff1-efba-443f-80ad-1aaffcef4ab8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:18.793271 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05cf0ff1-efba-443f-80ad-1aaffcef4ab8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:18.794013 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05cf0ff1-efba-443f-80ad-1aaffcef4ab8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:18.794832 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05cf0ff1-efba-443f-80ad-1aaffcef4ab8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:18.795265 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05cf0ff1-efba-443f-80ad-1aaffcef4ab8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:18.864050 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-05cf0ff1-efba-443f-80ad-1aaffcef4ab8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.084617 Jan 19 13:07:18.864604 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 271/527] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:18 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:07:18.895082 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-525977ca-574b-4ca0-a11b-1a0614914e6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.137316 Jan 19 13:07:18.898929 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 257/528] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:18 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:19.429749 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-baa3ad06-13d8-4bf1-93d7-08536c30f4e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:19.430738 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-baa3ad06-13d8-4bf1-93d7-08536c30f4e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:19.439230 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-baa3ad06-13d8-4bf1-93d7-08536c30f4e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:19.440673 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-baa3ad06-13d8-4bf1-93d7-08536c30f4e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:19.442168 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-baa3ad06-13d8-4bf1-93d7-08536c30f4e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:19.442841 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-baa3ad06-13d8-4bf1-93d7-08536c30f4e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:19.593094 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-baa3ad06-13d8-4bf1-93d7-08536c30f4e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:19.600847 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-baa3ad06-13d8-4bf1-93d7-08536c30f4e3 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.175754 Jan 19 13:07:19.601400 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 272/529] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:19 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:19.884453 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-015328ea-7be1-480e-a713-4bd466729c69 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:19.885780 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-015328ea-7be1-480e-a713-4bd466729c69 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:19.896023 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-015328ea-7be1-480e-a713-4bd466729c69 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:19.896758 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-015328ea-7be1-480e-a713-4bd466729c69 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:19.897806 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-015328ea-7be1-480e-a713-4bd466729c69 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:19.898376 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-015328ea-7be1-480e-a713-4bd466729c69 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:19.906048 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-948e2cce-a6b6-427c-a32e-08d930533e34 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:19.907686 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-948e2cce-a6b6-427c-a32e-08d930533e34 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:19.914513 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-948e2cce-a6b6-427c-a32e-08d930533e34 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:19.915168 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-948e2cce-a6b6-427c-a32e-08d930533e34 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:19.916209 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-948e2cce-a6b6-427c-a32e-08d930533e34 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:19.936603 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-948e2cce-a6b6-427c-a32e-08d930533e34 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:19.975125 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-015328ea-7be1-480e-a713-4bd466729c69 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.095058 Jan 19 13:07:19.979518 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 258/530] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:19 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:20.015453 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-948e2cce-a6b6-427c-a32e-08d930533e34 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.112983 Jan 19 13:07:20.016425 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 273/531] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:19 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:07:20.620822 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-673c21f5-6f26-4ddb-a713-518f8e0af5a5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:20.621887 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-673c21f5-6f26-4ddb-a713-518f8e0af5a5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:20.631831 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-673c21f5-6f26-4ddb-a713-518f8e0af5a5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:20.632320 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-673c21f5-6f26-4ddb-a713-518f8e0af5a5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:20.633549 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-673c21f5-6f26-4ddb-a713-518f8e0af5a5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:20.634061 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-673c21f5-6f26-4ddb-a713-518f8e0af5a5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:20.769291 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-673c21f5-6f26-4ddb-a713-518f8e0af5a5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:20.778313 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-673c21f5-6f26-4ddb-a713-518f8e0af5a5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.162553 Jan 19 13:07:20.787783 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 259/532] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:20 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:20.987765 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a5734bb4-f0f6-4990-9cd3-c2d6bfc861fe tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:20.988804 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a5734bb4-f0f6-4990-9cd3-c2d6bfc861fe tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:20.996995 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a5734bb4-f0f6-4990-9cd3-c2d6bfc861fe tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:20.997450 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a5734bb4-f0f6-4990-9cd3-c2d6bfc861fe tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:20.998256 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a5734bb4-f0f6-4990-9cd3-c2d6bfc861fe tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:20.998691 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a5734bb4-f0f6-4990-9cd3-c2d6bfc861fe tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:21.028581 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-59fd3516-0d41-45e4-a965-52b265ae2785 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:21.030703 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-59fd3516-0d41-45e4-a965-52b265ae2785 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:21.038937 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-59fd3516-0d41-45e4-a965-52b265ae2785 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:21.039709 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-59fd3516-0d41-45e4-a965-52b265ae2785 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:21.040775 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-59fd3516-0d41-45e4-a965-52b265ae2785 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:21.041412 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-59fd3516-0d41-45e4-a965-52b265ae2785 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:21.110268 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a5734bb4-f0f6-4990-9cd3-c2d6bfc861fe tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.126922 Jan 19 13:07:21.114827 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 274/533] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:20 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:21.130641 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-798462304", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452"}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:21.133900 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-59fd3516-0d41-45e4-a965-52b265ae2785 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.108928 Jan 19 13:07:21.139273 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 260/534] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:21 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:21.794932 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9fd7bb37-d543-42e6-9a9c-e533e771765a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:21.795857 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9fd7bb37-d543-42e6-9a9c-e533e771765a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:21.803141 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9fd7bb37-d543-42e6-9a9c-e533e771765a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:21.803622 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9fd7bb37-d543-42e6-9a9c-e533e771765a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:21.804461 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9fd7bb37-d543-42e6-9a9c-e533e771765a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:21.804900 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9fd7bb37-d543-42e6-9a9c-e533e771765a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:21.972660 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-9fd7bb37-d543-42e6-9a9c-e533e771765a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:21.981388 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9fd7bb37-d543-42e6-9a9c-e533e771765a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.190535 Jan 19 13:07:21.992056 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 261/535] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:21 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:22.126065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f13b18a2-664b-4268-8518-1771848ce2c5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:22.128124 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f13b18a2-664b-4268-8518-1771848ce2c5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:22.138772 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f13b18a2-664b-4268-8518-1771848ce2c5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:22.139746 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f13b18a2-664b-4268-8518-1771848ce2c5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:22.141613 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f13b18a2-664b-4268-8518-1771848ce2c5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:22.142369 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f13b18a2-664b-4268-8518-1771848ce2c5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:22.212256 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f13b18a2-664b-4268-8518-1771848ce2c5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.092850 Jan 19 13:07:22.213714 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 262/536] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:22 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:22.219063 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-10ab508e-47f2-48d2-9cfa-4d887f9cd332 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:22.220634 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-10ab508e-47f2-48d2-9cfa-4d887f9cd332 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:22.228471 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-10ab508e-47f2-48d2-9cfa-4d887f9cd332 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:22.229253 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-10ab508e-47f2-48d2-9cfa-4d887f9cd332 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:22.230544 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-10ab508e-47f2-48d2-9cfa-4d887f9cd332 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:22.231210 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-10ab508e-47f2-48d2-9cfa-4d887f9cd332 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:22.315934 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-10ab508e-47f2-48d2-9cfa-4d887f9cd332 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.099955 Jan 19 13:07:22.317175 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 263/537] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:22 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:23.001213 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0f0c989c-c759-4a35-aebb-f5aafe016c72 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:23.001825 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0f0c989c-c759-4a35-aebb-f5aafe016c72 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:23.011278 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0f0c989c-c759-4a35-aebb-f5aafe016c72 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:23.012002 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0f0c989c-c759-4a35-aebb-f5aafe016c72 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:23.012787 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0f0c989c-c759-4a35-aebb-f5aafe016c72 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:23.013224 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0f0c989c-c759-4a35-aebb-f5aafe016c72 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:23.161224 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0f0c989c-c759-4a35-aebb-f5aafe016c72 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:23.169480 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0f0c989c-c759-4a35-aebb-f5aafe016c72 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.172537 Jan 19 13:07:23.170089 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 264/538] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:22 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:07:23.228965 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-048b6681-d5e8-44f2-bea8-dd6cb0f7c49a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:23.230451 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-048b6681-d5e8-44f2-bea8-dd6cb0f7c49a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:23.240838 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-048b6681-d5e8-44f2-bea8-dd6cb0f7c49a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:23.241610 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-048b6681-d5e8-44f2-bea8-dd6cb0f7c49a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:23.242926 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-048b6681-d5e8-44f2-bea8-dd6cb0f7c49a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:23.243447 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-048b6681-d5e8-44f2-bea8-dd6cb0f7c49a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:23.324271 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-048b6681-d5e8-44f2-bea8-dd6cb0f7c49a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.101395 Jan 19 13:07:23.324934 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 265/539] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:23 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:23.329776 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-fe3af456-73ce-47a7-8185-229b68c68409 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:23.330933 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-fe3af456-73ce-47a7-8185-229b68c68409 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:23.337809 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fe3af456-73ce-47a7-8185-229b68c68409 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:23.338255 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fe3af456-73ce-47a7-8185-229b68c68409 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:23.339054 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fe3af456-73ce-47a7-8185-229b68c68409 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:23.339462 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fe3af456-73ce-47a7-8185-229b68c68409 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:23.409480 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-fe3af456-73ce-47a7-8185-229b68c68409 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.082821 Jan 19 13:07:23.409857 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 266/540] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:23 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:24.186785 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-25bbf87a-00c0-485b-833f-470d006d521a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:24.187433 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-25bbf87a-00c0-485b-833f-470d006d521a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:24.194479 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-25bbf87a-00c0-485b-833f-470d006d521a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:24.194935 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-25bbf87a-00c0-485b-833f-470d006d521a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:24.195717 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-25bbf87a-00c0-485b-833f-470d006d521a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:24.196187 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-25bbf87a-00c0-485b-833f-470d006d521a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:24.332538 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-25bbf87a-00c0-485b-833f-470d006d521a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:24.341305 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-25bbf87a-00c0-485b-833f-470d006d521a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.158659 Jan 19 13:07:24.342019 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 267/541] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:24 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:07:24.356924 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3f300d4a-d9ee-446b-88f8-62c31c6620ab tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:24.357977 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3f300d4a-d9ee-446b-88f8-62c31c6620ab tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:24.364373 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3f300d4a-d9ee-446b-88f8-62c31c6620ab tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:24.364908 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3f300d4a-d9ee-446b-88f8-62c31c6620ab tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:24.365796 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3f300d4a-d9ee-446b-88f8-62c31c6620ab tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:24.366334 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3f300d4a-d9ee-446b-88f8-62c31c6620ab tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:24.445198 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3f300d4a-d9ee-446b-88f8-62c31c6620ab tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.091578 Jan 19 13:07:24.450045 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 268/542] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:24 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:24.456243 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ab420155-6185-4aa4-89c1-a44bc77ef41d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:24.457803 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ab420155-6185-4aa4-89c1-a44bc77ef41d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:24.465444 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab420155-6185-4aa4-89c1-a44bc77ef41d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:24.466223 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab420155-6185-4aa4-89c1-a44bc77ef41d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:24.467129 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab420155-6185-4aa4-89c1-a44bc77ef41d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:24.467636 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab420155-6185-4aa4-89c1-a44bc77ef41d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:24.541111 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ab420155-6185-4aa4-89c1-a44bc77ef41d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.089289 Jan 19 13:07:24.545282 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 269/543] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:24 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:25.370475 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3cfd0080-d494-4174-ad91-ec81693f3ef4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:25.374054 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3cfd0080-d494-4174-ad91-ec81693f3ef4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:25.390210 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3cfd0080-d494-4174-ad91-ec81693f3ef4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:25.391471 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3cfd0080-d494-4174-ad91-ec81693f3ef4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:25.392651 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3cfd0080-d494-4174-ad91-ec81693f3ef4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:25.394467 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3cfd0080-d494-4174-ad91-ec81693f3ef4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:25.579814 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3cfd0080-d494-4174-ad91-ec81693f3ef4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:25.590279 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3cfd0080-d494-4174-ad91-ec81693f3ef4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.230925 Jan 19 13:07:25.590767 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 270/544] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:25 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:25.595437 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ce21c32f-d360-45f4-bf69-e821bf803ff8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:25.597584 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ce21c32f-d360-45f4-bf69-e821bf803ff8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:25.603700 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ce21c32f-d360-45f4-bf69-e821bf803ff8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:25.604231 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ce21c32f-d360-45f4-bf69-e821bf803ff8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:25.605049 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ce21c32f-d360-45f4-bf69-e821bf803ff8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:25.605511 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ce21c32f-d360-45f4-bf69-e821bf803ff8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:25.711027 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ce21c32f-d360-45f4-bf69-e821bf803ff8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.118654 Jan 19 13:07:25.711896 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 271/545] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:25 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:25.716986 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c028f3d8-39f5-4c0d-8121-09660cceeed3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:25.717987 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c028f3d8-39f5-4c0d-8121-09660cceeed3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:25.725632 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c028f3d8-39f5-4c0d-8121-09660cceeed3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:25.726084 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c028f3d8-39f5-4c0d-8121-09660cceeed3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:25.726868 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c028f3d8-39f5-4c0d-8121-09660cceeed3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:25.727306 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c028f3d8-39f5-4c0d-8121-09660cceeed3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:25.797223 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c028f3d8-39f5-4c0d-8121-09660cceeed3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.083931 Jan 19 13:07:25.797490 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.network.neutron [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] validate_networks() for None {{(pid=116361) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:07:25.797942 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 272/546] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:25 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:26.062230 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Flavor limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:07:26.062653 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Image limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:07:26.063112 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Flavor pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:07:26.063510 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Image pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:07:26.063912 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:07:26.072814 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:26.073266 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:26.074061 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:26.074491 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:26.090487 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Getting quotas for project ab6c38d411f94167b0bff8e26c9b89ef. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:07:26.094323 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Getting quotas for user 02228f6e32bf465ab08301cc170cb76c and project ab6c38d411f94167b0bff8e26c9b89ef. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:07:26.105275 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Going to run 1 instances... {{(pid=116361) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:07:26.107934 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:07:26.150474 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a04a43a7-a04b-4b58-8fc2-974f73851e32 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.025788 Jan 19 13:07:26.151110 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 275/547] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:07:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 5028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:07:26.161742 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d70c5928-928b-4213-9eb0-e7942e7b3bf5 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:26.162432 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d70c5928-928b-4213-9eb0-e7942e7b3bf5 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:26.219928 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d70c5928-928b-4213-9eb0-e7942e7b3bf5 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:26.227899 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d70c5928-928b-4213-9eb0-e7942e7b3bf5 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1214 microversion: 2.1 time: 0.070563 Jan 19 13:07:26.228575 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 273/548] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:26 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:26.607529 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a5d7f0a9-1145-47d4-988b-9b61cd72eac4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:26.608090 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a5d7f0a9-1145-47d4-988b-9b61cd72eac4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:26.614891 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a5d7f0a9-1145-47d4-988b-9b61cd72eac4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:26.615373 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a5d7f0a9-1145-47d4-988b-9b61cd72eac4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:26.616172 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a5d7f0a9-1145-47d4-988b-9b61cd72eac4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:26.616609 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a5d7f0a9-1145-47d4-988b-9b61cd72eac4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:26.722645 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-50c6ad44-f5ab-4bce-aaa7-4ab786a5f170 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:26.723575 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-50c6ad44-f5ab-4bce-aaa7-4ab786a5f170 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:26.730371 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50c6ad44-f5ab-4bce-aaa7-4ab786a5f170 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:26.730827 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50c6ad44-f5ab-4bce-aaa7-4ab786a5f170 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:26.731613 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50c6ad44-f5ab-4bce-aaa7-4ab786a5f170 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:26.732095 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50c6ad44-f5ab-4bce-aaa7-4ab786a5f170 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:26.747543 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-a5d7f0a9-1145-47d4-988b-9b61cd72eac4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:26.756110 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a5d7f0a9-1145-47d4-988b-9b61cd72eac4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.152214 Jan 19 13:07:26.756777 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 276/549] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:26 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:26.809366 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b2142654-db8f-4304-942e-a4bc94aa1a93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:26.810346 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b2142654-db8f-4304-942e-a4bc94aa1a93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:26.816234 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b2142654-db8f-4304-942e-a4bc94aa1a93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:26.817366 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b2142654-db8f-4304-942e-a4bc94aa1a93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:26.818149 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b2142654-db8f-4304-942e-a4bc94aa1a93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:26.818592 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b2142654-db8f-4304-942e-a4bc94aa1a93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:30.710877 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b2142654-db8f-4304-942e-a4bc94aa1a93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 3.904926 Jan 19 13:07:30.712401 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-50c6ad44-f5ab-4bce-aaa7-4ab786a5f170 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 3.993128 Jan 19 13:07:30.715449 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 277/550] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:26 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 3910 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:07:30.716474 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 274/551] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:26 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 3998 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:07:30.720989 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-86f150ec-efc6-4888-80a3-53be330339b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:30.721406 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-bed0df72-0aaa-42f5-b293-f960c921c268 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:30.721693 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-86f150ec-efc6-4888-80a3-53be330339b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:30.722104 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-bed0df72-0aaa-42f5-b293-f960c921c268 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:30.729335 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-86f150ec-efc6-4888-80a3-53be330339b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:30.729841 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-86f150ec-efc6-4888-80a3-53be330339b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:30.730634 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-86f150ec-efc6-4888-80a3-53be330339b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:30.731074 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-86f150ec-efc6-4888-80a3-53be330339b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:30.731903 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bed0df72-0aaa-42f5-b293-f960c921c268 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:30.732410 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bed0df72-0aaa-42f5-b293-f960c921c268 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:30.733226 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bed0df72-0aaa-42f5-b293-f960c921c268 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:30.733855 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bed0df72-0aaa-42f5-b293-f960c921c268 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:30.830161 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-86f150ec-efc6-4888-80a3-53be330339b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:30.838100 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-86f150ec-efc6-4888-80a3-53be330339b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1218 microversion: 2.1 time: 0.121156 Jan 19 13:07:30.838872 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 278/552] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:30 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:30.903642 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bed0df72-0aaa-42f5-b293-f960c921c268 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:30.911630 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-bed0df72-0aaa-42f5-b293-f960c921c268 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.194015 Jan 19 13:07:30.912221 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 275/553] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:30 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:31.725320 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-79197a5d-5d5e-4cc3-baa3-0c1db29f084a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:31.727730 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-79197a5d-5d5e-4cc3-baa3-0c1db29f084a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:31.734997 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0c08ba5c-68da-449f-ba5f-ea7a6118de16 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:31.736129 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0c08ba5c-68da-449f-ba5f-ea7a6118de16 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:31.736253 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-79197a5d-5d5e-4cc3-baa3-0c1db29f084a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:31.736920 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-79197a5d-5d5e-4cc3-baa3-0c1db29f084a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:31.737872 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-79197a5d-5d5e-4cc3-baa3-0c1db29f084a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:31.738466 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-79197a5d-5d5e-4cc3-baa3-0c1db29f084a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:31.744516 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0c08ba5c-68da-449f-ba5f-ea7a6118de16 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:31.744972 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0c08ba5c-68da-449f-ba5f-ea7a6118de16 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:31.748194 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0c08ba5c-68da-449f-ba5f-ea7a6118de16 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:31.748648 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0c08ba5c-68da-449f-ba5f-ea7a6118de16 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:31.837363 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-79197a5d-5d5e-4cc3-baa3-0c1db29f084a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.116830 Jan 19 13:07:31.838197 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 279/554] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:31 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:31.855039 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3e0e02be-d140-4980-9771-e11012c19867 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:31.855812 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3e0e02be-d140-4980-9771-e11012c19867 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:31.863165 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3e0e02be-d140-4980-9771-e11012c19867 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:31.863584 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0c08ba5c-68da-449f-ba5f-ea7a6118de16 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.132588 Jan 19 13:07:31.864186 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3e0e02be-d140-4980-9771-e11012c19867 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:31.867728 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 276/555] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:31 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:31.869557 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3e0e02be-d140-4980-9771-e11012c19867 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:31.870015 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3e0e02be-d140-4980-9771-e11012c19867 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:31.930099 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c00eadef-ba32-4df5-957c-1b3aa790e7c2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:31.930705 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c00eadef-ba32-4df5-957c-1b3aa790e7c2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:31.936470 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3e0e02be-d140-4980-9771-e11012c19867 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:31.938031 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c00eadef-ba32-4df5-957c-1b3aa790e7c2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:31.938492 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c00eadef-ba32-4df5-957c-1b3aa790e7c2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:31.939283 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c00eadef-ba32-4df5-957c-1b3aa790e7c2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:31.939722 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c00eadef-ba32-4df5-957c-1b3aa790e7c2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:31.948059 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3e0e02be-d140-4980-9771-e11012c19867 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1272 microversion: 2.1 time: 0.096942 Jan 19 13:07:31.948737 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 280/556] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:31 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:07:32.131080 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c00eadef-ba32-4df5-957c-1b3aa790e7c2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:32.132050 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c00eadef-ba32-4df5-957c-1b3aa790e7c2 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.206645 Jan 19 13:07:32.132625 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 277/557] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:31 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:07:32.849139 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2feb076d-f943-4bdf-a631-0cb9fdaebdda tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:32.850241 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2feb076d-f943-4bdf-a631-0cb9fdaebdda tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:32.858050 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2feb076d-f943-4bdf-a631-0cb9fdaebdda tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:32.858652 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2feb076d-f943-4bdf-a631-0cb9fdaebdda tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:32.859487 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2feb076d-f943-4bdf-a631-0cb9fdaebdda tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:32.860109 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2feb076d-f943-4bdf-a631-0cb9fdaebdda tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:32.875247 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-29581861-87fd-4fd9-8d16-2c3d102551f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:32.876215 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-29581861-87fd-4fd9-8d16-2c3d102551f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:32.883730 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-29581861-87fd-4fd9-8d16-2c3d102551f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:32.884562 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-29581861-87fd-4fd9-8d16-2c3d102551f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:32.885502 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-29581861-87fd-4fd9-8d16-2c3d102551f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:32.885950 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-29581861-87fd-4fd9-8d16-2c3d102551f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:32.989340 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-29581861-87fd-4fd9-8d16-2c3d102551f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.117629 Jan 19 13:07:32.993513 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 278/558] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:32 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:07:32.993650 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2feb076d-f943-4bdf-a631-0cb9fdaebdda tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.148384 Jan 19 13:07:32.997328 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ff0bdf16-7477-4a47-9487-10725ecf7ff0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:32.997498 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 281/559] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:32 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:32.997614 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ff0bdf16-7477-4a47-9487-10725ecf7ff0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:33.003001 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff0bdf16-7477-4a47-9487-10725ecf7ff0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:33.003333 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff0bdf16-7477-4a47-9487-10725ecf7ff0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:33.005010 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff0bdf16-7477-4a47-9487-10725ecf7ff0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:33.005626 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff0bdf16-7477-4a47-9487-10725ecf7ff0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:33.151276 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-736869b5-3f6a-43cb-9fce-bf28daefd291 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:33.152176 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-736869b5-3f6a-43cb-9fce-bf28daefd291 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:33.160089 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-736869b5-3f6a-43cb-9fce-bf28daefd291 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:33.160800 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-736869b5-3f6a-43cb-9fce-bf28daefd291 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:33.161854 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-736869b5-3f6a-43cb-9fce-bf28daefd291 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:33.162533 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-736869b5-3f6a-43cb-9fce-bf28daefd291 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:33.253342 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ff0bdf16-7477-4a47-9487-10725ecf7ff0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:33.262001 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ff0bdf16-7477-4a47-9487-10725ecf7ff0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1314 microversion: 2.1 time: 0.270565 Jan 19 13:07:33.262579 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 279/560] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:32 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:33.353672 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-dc03c9e0-cf7b-4af9-9c83-c6067aed613e req-70af6446-ff63-43b0-a885-790fba413658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "924c20fc-437f-4043-a8ee-38318a5f35c2", "tag": "e17b8a3e-fabe-418f-ac5d-1604def05474"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:33.356034 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:07:33.356034 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:07:33.366328 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-dc03c9e0-cf7b-4af9-9c83-c6067aed613e req-70af6446-ff63-43b0-a885-790fba413658 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:33.366949 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-dc03c9e0-cf7b-4af9-9c83-c6067aed613e req-70af6446-ff63-43b0-a885-790fba413658 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:33.380862 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-dc03c9e0-cf7b-4af9-9c83-c6067aed613e req-70af6446-ff63-43b0-a885-790fba413658 service nova] Creating event network-changed:e17b8a3e-fabe-418f-ac5d-1604def05474 for instance 924c20fc-437f-4043-a8ee-38318a5f35c2 on hv-cinder-82301 Jan 19 13:07:33.387145 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-dc03c9e0-cf7b-4af9-9c83-c6067aed613e req-70af6446-ff63-43b0-a885-790fba413658 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038182 Jan 19 13:07:33.388380 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 280/561] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:07:33.464086 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-736869b5-3f6a-43cb-9fce-bf28daefd291 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:33.480723 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-736869b5-3f6a-43cb-9fce-bf28daefd291 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.334546 Jan 19 13:07:33.481387 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 282/562] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:33 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:07:34.001913 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3b3cdd47-7d46-4e7f-a813-a4a83aa24401 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:34.003084 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3b3cdd47-7d46-4e7f-a813-a4a83aa24401 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:34.006728 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1c8a7b98-af8b-4988-8bbc-d3e48a14a9a8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:34.007643 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1c8a7b98-af8b-4988-8bbc-d3e48a14a9a8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:34.011305 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3b3cdd47-7d46-4e7f-a813-a4a83aa24401 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:34.012625 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3b3cdd47-7d46-4e7f-a813-a4a83aa24401 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:34.013455 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3b3cdd47-7d46-4e7f-a813-a4a83aa24401 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:34.013895 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3b3cdd47-7d46-4e7f-a813-a4a83aa24401 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:34.014282 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1c8a7b98-af8b-4988-8bbc-d3e48a14a9a8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:34.014889 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1c8a7b98-af8b-4988-8bbc-d3e48a14a9a8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:34.015661 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1c8a7b98-af8b-4988-8bbc-d3e48a14a9a8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:34.016131 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1c8a7b98-af8b-4988-8bbc-d3e48a14a9a8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:34.617366 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1c8a7b98-af8b-4988-8bbc-d3e48a14a9a8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.615803 Jan 19 13:07:34.618014 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 283/563] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:34 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:34.622776 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-bec97e6c-d36d-4b63-84d3-e01f7cc207ee tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:34.623464 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-bec97e6c-d36d-4b63-84d3-e01f7cc207ee tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:34.626018 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3b3cdd47-7d46-4e7f-a813-a4a83aa24401 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.628057 Jan 19 13:07:34.630898 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 281/564] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:33 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:34.631332 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bec97e6c-d36d-4b63-84d3-e01f7cc207ee tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:34.631784 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bec97e6c-d36d-4b63-84d3-e01f7cc207ee tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:34.632272 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-73dbb103-4f69-488f-b384-232c371accc4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:34.632627 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bec97e6c-d36d-4b63-84d3-e01f7cc207ee tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:34.632952 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-73dbb103-4f69-488f-b384-232c371accc4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:34.633064 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bec97e6c-d36d-4b63-84d3-e01f7cc207ee tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:34.639674 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-73dbb103-4f69-488f-b384-232c371accc4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:34.640149 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-73dbb103-4f69-488f-b384-232c371accc4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:34.641047 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-73dbb103-4f69-488f-b384-232c371accc4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:34.641485 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-73dbb103-4f69-488f-b384-232c371accc4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:34.839221 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-73dbb103-4f69-488f-b384-232c371accc4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:34.842683 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-bec97e6c-d36d-4b63-84d3-e01f7cc207ee tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:34.846988 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-73dbb103-4f69-488f-b384-232c371accc4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.219150 Jan 19 13:07:34.848424 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 282/565] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:34 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:34.851051 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-bec97e6c-d36d-4b63-84d3-e01f7cc207ee tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1314 microversion: 2.1 time: 0.231913 Jan 19 13:07:34.851609 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 284/566] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:34 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:35.631714 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-112e60fc-3133-4054-a61a-a33e9328fdb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:35.632874 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-112e60fc-3133-4054-a61a-a33e9328fdb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:35.638260 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7d029465-8c81-4246-aa13-705a57a03e0d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:35.639231 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7d029465-8c81-4246-aa13-705a57a03e0d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:35.639534 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-112e60fc-3133-4054-a61a-a33e9328fdb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:35.640204 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-112e60fc-3133-4054-a61a-a33e9328fdb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:35.641109 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-112e60fc-3133-4054-a61a-a33e9328fdb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:35.641628 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-112e60fc-3133-4054-a61a-a33e9328fdb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:35.649990 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d029465-8c81-4246-aa13-705a57a03e0d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:35.649990 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d029465-8c81-4246-aa13-705a57a03e0d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:35.649990 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d029465-8c81-4246-aa13-705a57a03e0d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:35.649990 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7d029465-8c81-4246-aa13-705a57a03e0d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:35.746335 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-112e60fc-3133-4054-a61a-a33e9328fdb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.120663 Jan 19 13:07:35.747425 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 283/567] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:35 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:35.864731 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-bcc95f1f-52f0-4e78-8140-54a2054d472d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:35.865426 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-bcc95f1f-52f0-4e78-8140-54a2054d472d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:35.872034 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bcc95f1f-52f0-4e78-8140-54a2054d472d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:35.872182 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7d029465-8c81-4246-aa13-705a57a03e0d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.238109 Jan 19 13:07:35.872487 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bcc95f1f-52f0-4e78-8140-54a2054d472d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:35.872815 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 285/568] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:35 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:07:35.873264 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bcc95f1f-52f0-4e78-8140-54a2054d472d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:35.873876 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bcc95f1f-52f0-4e78-8140-54a2054d472d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:35.878026 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-25e747ee-a5f6-477b-ae19-c1d7877fdb50 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:35.879256 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-25e747ee-a5f6-477b-ae19-c1d7877fdb50 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:35.886144 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-25e747ee-a5f6-477b-ae19-c1d7877fdb50 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:35.887229 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-25e747ee-a5f6-477b-ae19-c1d7877fdb50 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:35.888051 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-25e747ee-a5f6-477b-ae19-c1d7877fdb50 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:35.888511 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-25e747ee-a5f6-477b-ae19-c1d7877fdb50 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:36.125770 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bcc95f1f-52f0-4e78-8140-54a2054d472d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:36.130715 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-25e747ee-a5f6-477b-ae19-c1d7877fdb50 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:36.133711 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-bcc95f1f-52f0-4e78-8140-54a2054d472d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.273361 Jan 19 13:07:36.134276 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 284/569] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:35 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:07:36.143255 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-25e747ee-a5f6-477b-ae19-c1d7877fdb50 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1314 microversion: 2.1 time: 0.265757 Jan 19 13:07:36.143255 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 286/570] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:35 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:36.758269 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c6a9cbc8-8c1e-4e2a-994b-e46c34605029 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:36.759231 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c6a9cbc8-8c1e-4e2a-994b-e46c34605029 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:36.765669 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c6a9cbc8-8c1e-4e2a-994b-e46c34605029 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:36.766123 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c6a9cbc8-8c1e-4e2a-994b-e46c34605029 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:36.766940 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c6a9cbc8-8c1e-4e2a-994b-e46c34605029 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:36.767385 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c6a9cbc8-8c1e-4e2a-994b-e46c34605029 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:36.835824 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c6a9cbc8-8c1e-4e2a-994b-e46c34605029 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.081419 Jan 19 13:07:36.836527 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 287/571] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:36 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:36.883943 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3a75de13-cc9b-489a-95e3-6127a7b6a737 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:36.884884 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3a75de13-cc9b-489a-95e3-6127a7b6a737 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:36.891199 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3a75de13-cc9b-489a-95e3-6127a7b6a737 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:36.891646 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3a75de13-cc9b-489a-95e3-6127a7b6a737 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:36.892435 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3a75de13-cc9b-489a-95e3-6127a7b6a737 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:36.892869 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3a75de13-cc9b-489a-95e3-6127a7b6a737 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:36.958146 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3a75de13-cc9b-489a-95e3-6127a7b6a737 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.077533 Jan 19 13:07:36.958829 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 285/572] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:36 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:37.151637 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-fb67c61d-d139-43b8-a09c-b2650ba415f6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:37.152656 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-fb67c61d-d139-43b8-a09c-b2650ba415f6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:37.157530 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0d866ab3-021f-4210-9f6e-6aa33c8d0e4d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:37.158228 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0d866ab3-021f-4210-9f6e-6aa33c8d0e4d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:37.160236 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fb67c61d-d139-43b8-a09c-b2650ba415f6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:37.160701 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fb67c61d-d139-43b8-a09c-b2650ba415f6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:37.161496 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fb67c61d-d139-43b8-a09c-b2650ba415f6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:37.161936 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fb67c61d-d139-43b8-a09c-b2650ba415f6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:37.165630 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0d866ab3-021f-4210-9f6e-6aa33c8d0e4d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:37.166331 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0d866ab3-021f-4210-9f6e-6aa33c8d0e4d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:37.167189 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0d866ab3-021f-4210-9f6e-6aa33c8d0e4d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:37.167698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0d866ab3-021f-4210-9f6e-6aa33c8d0e4d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:37.368902 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-fb67c61d-d139-43b8-a09c-b2650ba415f6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:37.379854 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-fb67c61d-d139-43b8-a09c-b2650ba415f6 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.231996 Jan 19 13:07:37.392636 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 288/573] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:37 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:37.397706 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0d866ab3-021f-4210-9f6e-6aa33c8d0e4d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:37.407708 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0d866ab3-021f-4210-9f6e-6aa33c8d0e4d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1314 microversion: 2.1 time: 0.254222 Jan 19 13:07:37.408571 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 286/574] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:37 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:37.848006 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5389a30d-34ec-4be3-b5b3-cfc37b4b4d0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:37.849123 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5389a30d-34ec-4be3-b5b3-cfc37b4b4d0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:37.855505 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5389a30d-34ec-4be3-b5b3-cfc37b4b4d0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:37.855956 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5389a30d-34ec-4be3-b5b3-cfc37b4b4d0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:37.856774 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5389a30d-34ec-4be3-b5b3-cfc37b4b4d0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:37.857388 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5389a30d-34ec-4be3-b5b3-cfc37b4b4d0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:37.969451 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5389a30d-34ec-4be3-b5b3-cfc37b4b4d0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.125223 Jan 19 13:07:37.970850 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 289/575] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:37 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:37.970965 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-88086667-c550-4296-b93f-60286b25460a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:37.972035 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-88086667-c550-4296-b93f-60286b25460a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:37.979399 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-88086667-c550-4296-b93f-60286b25460a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:37.979846 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-88086667-c550-4296-b93f-60286b25460a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:37.980649 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-88086667-c550-4296-b93f-60286b25460a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:37.981088 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-88086667-c550-4296-b93f-60286b25460a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:38.094693 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-88086667-c550-4296-b93f-60286b25460a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.128402 Jan 19 13:07:38.095431 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 287/576] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:37 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:07:38.398875 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0e038e32-e74a-4cd9-9227-cf6d2321842d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:38.399585 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0e038e32-e74a-4cd9-9227-cf6d2321842d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:38.406341 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0e038e32-e74a-4cd9-9227-cf6d2321842d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:38.406785 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0e038e32-e74a-4cd9-9227-cf6d2321842d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:38.407554 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0e038e32-e74a-4cd9-9227-cf6d2321842d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:38.408018 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0e038e32-e74a-4cd9-9227-cf6d2321842d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:38.426708 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-53ac13a0-4287-456b-8f68-83422495270d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:38.427895 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-53ac13a0-4287-456b-8f68-83422495270d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:38.436701 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-53ac13a0-4287-456b-8f68-83422495270d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:38.437151 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-53ac13a0-4287-456b-8f68-83422495270d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:38.438223 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-53ac13a0-4287-456b-8f68-83422495270d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:38.438829 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-53ac13a0-4287-456b-8f68-83422495270d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:38.637463 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0e038e32-e74a-4cd9-9227-cf6d2321842d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:38.641827 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-53ac13a0-4287-456b-8f68-83422495270d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:38.647279 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0e038e32-e74a-4cd9-9227-cf6d2321842d tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.252270 Jan 19 13:07:38.648105 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 290/577] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:38 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:38.650759 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-53ac13a0-4287-456b-8f68-83422495270d tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1314 microversion: 2.1 time: 0.228693 Jan 19 13:07:38.651675 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 288/578] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:38 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:38.982305 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-71290f70-f201-4320-bdd4-69ecc9b98943 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:38.983239 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-71290f70-f201-4320-bdd4-69ecc9b98943 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:38.990037 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-71290f70-f201-4320-bdd4-69ecc9b98943 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:38.990498 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-71290f70-f201-4320-bdd4-69ecc9b98943 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:38.991280 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-71290f70-f201-4320-bdd4-69ecc9b98943 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:38.991718 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-71290f70-f201-4320-bdd4-69ecc9b98943 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:39.079179 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-71290f70-f201-4320-bdd4-69ecc9b98943 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.100501 Jan 19 13:07:39.083306 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 291/579] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:38 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:39.106387 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-73e4f2bb-7b33-4bef-b5fc-1b39fdfe1e41 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:39.107313 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-73e4f2bb-7b33-4bef-b5fc-1b39fdfe1e41 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:39.114176 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-73e4f2bb-7b33-4bef-b5fc-1b39fdfe1e41 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:39.114640 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-73e4f2bb-7b33-4bef-b5fc-1b39fdfe1e41 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:39.115434 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-73e4f2bb-7b33-4bef-b5fc-1b39fdfe1e41 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:39.115878 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-73e4f2bb-7b33-4bef-b5fc-1b39fdfe1e41 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:39.277787 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-73e4f2bb-7b33-4bef-b5fc-1b39fdfe1e41 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.174879 Jan 19 13:07:39.278669 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 289/580] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:39 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:39.666289 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-eeddf082-16b2-46b3-ab47-c663e883e5ff tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:39.667085 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-eeddf082-16b2-46b3-ab47-c663e883e5ff tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:39.669087 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-831fcab8-b569-4e46-9e5c-2e99189fddba tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:39.669780 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-831fcab8-b569-4e46-9e5c-2e99189fddba tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:39.674565 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eeddf082-16b2-46b3-ab47-c663e883e5ff tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:39.675122 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eeddf082-16b2-46b3-ab47-c663e883e5ff tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:39.677079 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eeddf082-16b2-46b3-ab47-c663e883e5ff tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:39.677544 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eeddf082-16b2-46b3-ab47-c663e883e5ff tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:39.677885 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-831fcab8-b569-4e46-9e5c-2e99189fddba tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:39.678342 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-831fcab8-b569-4e46-9e5c-2e99189fddba tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:39.679123 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-831fcab8-b569-4e46-9e5c-2e99189fddba tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:39.679564 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-831fcab8-b569-4e46-9e5c-2e99189fddba tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:39.869243 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-eeddf082-16b2-46b3-ab47-c663e883e5ff tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:39.872572 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-831fcab8-b569-4e46-9e5c-2e99189fddba tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:39.878785 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-eeddf082-16b2-46b3-ab47-c663e883e5ff tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.216464 Jan 19 13:07:39.879462 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 292/581] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:39 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:39.880529 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-831fcab8-b569-4e46-9e5c-2e99189fddba tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1314 microversion: 2.1 time: 0.215221 Jan 19 13:07:39.881099 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 290/582] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:39 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:07:40.090746 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-af50130b-8a2d-4ba3-ba6d-cc167bedba77 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:40.091824 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-af50130b-8a2d-4ba3-ba6d-cc167bedba77 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:40.099179 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-af50130b-8a2d-4ba3-ba6d-cc167bedba77 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:40.099658 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-af50130b-8a2d-4ba3-ba6d-cc167bedba77 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:40.100472 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-af50130b-8a2d-4ba3-ba6d-cc167bedba77 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:40.100962 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-af50130b-8a2d-4ba3-ba6d-cc167bedba77 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:40.213516 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-af50130b-8a2d-4ba3-ba6d-cc167bedba77 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.126301 Jan 19 13:07:40.214158 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 293/583] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:40 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:40.290171 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5e78cb78-ae33-4a0b-8365-f247ac4047a3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:40.291096 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5e78cb78-ae33-4a0b-8365-f247ac4047a3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:40.297471 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e78cb78-ae33-4a0b-8365-f247ac4047a3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:40.297941 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e78cb78-ae33-4a0b-8365-f247ac4047a3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:40.298698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e78cb78-ae33-4a0b-8365-f247ac4047a3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:40.299137 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e78cb78-ae33-4a0b-8365-f247ac4047a3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:40.364715 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5e78cb78-ae33-4a0b-8365-f247ac4047a3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.077839 Jan 19 13:07:40.365431 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 291/584] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:40 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:40.897026 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d8917a52-0aed-421b-be70-768e4267dddf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:40.897726 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d8917a52-0aed-421b-be70-768e4267dddf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:40.897958 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2f6b4bb9-54dd-4a16-9810-bc00245c16b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:40.898910 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2f6b4bb9-54dd-4a16-9810-bc00245c16b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:40.904744 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d8917a52-0aed-421b-be70-768e4267dddf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:40.905395 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d8917a52-0aed-421b-be70-768e4267dddf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:40.905597 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2f6b4bb9-54dd-4a16-9810-bc00245c16b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:40.906187 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d8917a52-0aed-421b-be70-768e4267dddf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:40.906323 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2f6b4bb9-54dd-4a16-9810-bc00245c16b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:40.906627 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d8917a52-0aed-421b-be70-768e4267dddf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:40.906973 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2f6b4bb9-54dd-4a16-9810-bc00245c16b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:40.907407 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2f6b4bb9-54dd-4a16-9810-bc00245c16b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:41.161716 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2f6b4bb9-54dd-4a16-9810-bc00245c16b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:41.165467 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d8917a52-0aed-421b-be70-768e4267dddf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:41.169268 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2f6b4bb9-54dd-4a16-9810-bc00245c16b4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1314 microversion: 2.1 time: 0.275731 Jan 19 13:07:41.169938 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 292/585] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:40 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:07:41.173801 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d8917a52-0aed-421b-be70-768e4267dddf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1567 microversion: 2.1 time: 0.281652 Jan 19 13:07:41.174363 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 294/586] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:40 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1567 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:41.226019 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ec9855f5-6958-4912-835b-e102c804c332 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:41.226929 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ec9855f5-6958-4912-835b-e102c804c332 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:41.233271 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ec9855f5-6958-4912-835b-e102c804c332 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:41.233718 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ec9855f5-6958-4912-835b-e102c804c332 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:41.234484 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ec9855f5-6958-4912-835b-e102c804c332 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:41.234914 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ec9855f5-6958-4912-835b-e102c804c332 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:41.301837 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ec9855f5-6958-4912-835b-e102c804c332 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.080016 Jan 19 13:07:41.302489 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 293/587] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:41 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:41.375800 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6d07cc48-dbaa-4170-93f9-fe1720960a0b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:41.376749 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6d07cc48-dbaa-4170-93f9-fe1720960a0b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:41.383175 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d07cc48-dbaa-4170-93f9-fe1720960a0b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:41.383625 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d07cc48-dbaa-4170-93f9-fe1720960a0b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:41.384427 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d07cc48-dbaa-4170-93f9-fe1720960a0b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:41.384866 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d07cc48-dbaa-4170-93f9-fe1720960a0b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:41.856836 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-3ae9fe81-583f-44e7-9476-9e0df6be2341 req-ac7be64b-d77a-430a-8786-f5f5bc7d99eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "924c20fc-437f-4043-a8ee-38318a5f35c2", "name": "network-vif-plugged", "status": "completed", "tag": "e17b8a3e-fabe-418f-ac5d-1604def05474"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:41.858850 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:07:41.858850 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:07:41.869092 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-3ae9fe81-583f-44e7-9476-9e0df6be2341 req-ac7be64b-d77a-430a-8786-f5f5bc7d99eb service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:41.869377 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-3ae9fe81-583f-44e7-9476-9e0df6be2341 req-ac7be64b-d77a-430a-8786-f5f5bc7d99eb service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:41.881477 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-3ae9fe81-583f-44e7-9476-9e0df6be2341 req-ac7be64b-d77a-430a-8786-f5f5bc7d99eb service nova] Creating event network-vif-plugged:e17b8a3e-fabe-418f-ac5d-1604def05474 for instance 924c20fc-437f-4043-a8ee-38318a5f35c2 on hv-cinder-82301 Jan 19 13:07:41.886110 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-3ae9fe81-583f-44e7-9476-9e0df6be2341 req-ac7be64b-d77a-430a-8786-f5f5bc7d99eb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033786 Jan 19 13:07:41.886961 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 294/588] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:07:41.954179 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6d07cc48-dbaa-4170-93f9-fe1720960a0b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.581752 Jan 19 13:07:41.955029 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 295/589] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:41 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:42.187222 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0fdeb76d-6766-4ecd-9375-a1fdbdcbe668 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:42.187915 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0fdeb76d-6766-4ecd-9375-a1fdbdcbe668 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:42.190720 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f1b67a45-fa03-4735-8185-161936890b6e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:42.192686 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f1b67a45-fa03-4735-8185-161936890b6e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:42.194736 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0fdeb76d-6766-4ecd-9375-a1fdbdcbe668 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:42.195188 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0fdeb76d-6766-4ecd-9375-a1fdbdcbe668 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:42.195968 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0fdeb76d-6766-4ecd-9375-a1fdbdcbe668 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:42.196427 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0fdeb76d-6766-4ecd-9375-a1fdbdcbe668 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:42.199442 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f1b67a45-fa03-4735-8185-161936890b6e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:42.199895 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f1b67a45-fa03-4735-8185-161936890b6e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:42.200698 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f1b67a45-fa03-4735-8185-161936890b6e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:42.201137 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f1b67a45-fa03-4735-8185-161936890b6e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:42.388926 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0fdeb76d-6766-4ecd-9375-a1fdbdcbe668 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:42.396829 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0fdeb76d-6766-4ecd-9375-a1fdbdcbe668 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1314 microversion: 2.1 time: 0.213952 Jan 19 13:07:42.397249 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f1b67a45-fa03-4735-8185-161936890b6e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:42.397387 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 295/590] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:42 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:42.401725 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-68aadd24-e7e3-4de1-b767-cca62b98ebbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:42.402622 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-68aadd24-e7e3-4de1-b767-cca62b98ebbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:42.405306 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f1b67a45-fa03-4735-8185-161936890b6e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1547 microversion: 2.1 time: 0.218544 Jan 19 13:07:42.406056 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 296/591] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:42 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1547 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:07:42.408387 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-68aadd24-e7e3-4de1-b767-cca62b98ebbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:42.408836 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-68aadd24-e7e3-4de1-b767-cca62b98ebbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:42.409610 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-68aadd24-e7e3-4de1-b767-cca62b98ebbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:42.410046 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-68aadd24-e7e3-4de1-b767-cca62b98ebbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:42.421316 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-71386a7e-0c93-43d5-a6c8-3385a5062e06 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:42.421812 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-71386a7e-0c93-43d5-a6c8-3385a5062e06 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:42.427669 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-71386a7e-0c93-43d5-a6c8-3385a5062e06 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:42.428163 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-71386a7e-0c93-43d5-a6c8-3385a5062e06 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:42.428950 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-71386a7e-0c93-43d5-a6c8-3385a5062e06 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:42.429391 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-71386a7e-0c93-43d5-a6c8-3385a5062e06 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:42.550997 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-71386a7e-0c93-43d5-a6c8-3385a5062e06 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] HTTP exception thrown: Cannot 'detach_volume' instance 9b74c954-19e1-498d-a9b6-c0fb2663635a while it is in vm_state rescued Jan 19 13:07:42.551607 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-71386a7e-0c93-43d5-a6c8-3385a5062e06 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Returning 409 to user: Cannot 'detach_volume' instance 9b74c954-19e1-498d-a9b6-c0fb2663635a while it is in vm_state rescued {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:07:42.552469 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-71386a7e-0c93-43d5-a6c8-3385a5062e06 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/os-volume_attachments/903d8736-7abf-4e95-95cc-d3ef8a9777ff" status: 409 len: 152 microversion: 2.1 time: 0.134906 Jan 19 13:07:42.553015 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 297/592] 10.222.0.48 () {58 vars in 1415 bytes} [Wed Jan 19 13:07:42 2022] DELETE /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/os-volume_attachments/903d8736-7abf-4e95-95cc-d3ef8a9777ff => generated 152 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 19 13:07:42.560758 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-61ed361e-a892-4f5d-ad41-1a42dbd018af tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:42.561228 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-61ed361e-a892-4f5d-ad41-1a42dbd018af tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:42.567579 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-61ed361e-a892-4f5d-ad41-1a42dbd018af tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:42.568064 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-61ed361e-a892-4f5d-ad41-1a42dbd018af tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:42.568837 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-61ed361e-a892-4f5d-ad41-1a42dbd018af tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:42.569272 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-61ed361e-a892-4f5d-ad41-1a42dbd018af tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:42.632818 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-61ed361e-a892-4f5d-ad41-1a42dbd018af tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "POST /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/action" status: 202 len: 0 microversion: 2.1 time: 0.075310 Jan 19 13:07:42.633440 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 298/593] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:42 2022] POST /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:07:42.649472 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ee25b0ef-7c8c-4fbe-9a72-2e056618fb9c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:42.649472 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ee25b0ef-7c8c-4fbe-9a72-2e056618fb9c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:42.650655 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ee25b0ef-7c8c-4fbe-9a72-2e056618fb9c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:42.651380 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ee25b0ef-7c8c-4fbe-9a72-2e056618fb9c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:42.652319 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ee25b0ef-7c8c-4fbe-9a72-2e056618fb9c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:42.652832 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ee25b0ef-7c8c-4fbe-9a72-2e056618fb9c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:42.783771 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ee25b0ef-7c8c-4fbe-9a72-2e056618fb9c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:42.792460 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ee25b0ef-7c8c-4fbe-9a72-2e056618fb9c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1555 microversion: 2.1 time: 0.154467 Jan 19 13:07:42.793017 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 299/594] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:42 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:07:42.966201 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3edc2c63-f676-4a30-9adc-fc4fe86d86d9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:42.967163 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3edc2c63-f676-4a30-9adc-fc4fe86d86d9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:42.973239 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3edc2c63-f676-4a30-9adc-fc4fe86d86d9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:42.973672 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3edc2c63-f676-4a30-9adc-fc4fe86d86d9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:42.974435 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3edc2c63-f676-4a30-9adc-fc4fe86d86d9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:42.974863 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3edc2c63-f676-4a30-9adc-fc4fe86d86d9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:43.527295 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:07:43.527910 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: Wed Jan 19 13:07:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action (ip 10.222.0.48) !!! Jan 19 13:07:49.217493 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3edc2c63-f676-4a30-9adc-fc4fe86d86d9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 6.254608 Jan 19 13:07:49.218119 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 300/595] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:42 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 6256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:07:49.223387 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-115c65de-42b0-4d63-983d-4ce14a9c1612 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:49.224180 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-115c65de-42b0-4d63-983d-4ce14a9c1612 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:49.227995 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-68aadd24-e7e3-4de1-b767-cca62b98ebbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 6.829368 Jan 19 13:07:49.228655 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 296/596] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:42 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 6831 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:49.232357 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-115c65de-42b0-4d63-983d-4ce14a9c1612 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:49.232809 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-115c65de-42b0-4d63-983d-4ce14a9c1612 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:49.233591 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-115c65de-42b0-4d63-983d-4ce14a9c1612 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:49.234023 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-115c65de-42b0-4d63-983d-4ce14a9c1612 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:49.234915 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-06132968-06b9-41f6-9985-d2be25ed2e0b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:49.235605 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-06132968-06b9-41f6-9985-d2be25ed2e0b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:49.245493 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-06132968-06b9-41f6-9985-d2be25ed2e0b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:49.245949 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-06132968-06b9-41f6-9985-d2be25ed2e0b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:49.246791 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-06132968-06b9-41f6-9985-d2be25ed2e0b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:49.247232 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-06132968-06b9-41f6-9985-d2be25ed2e0b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:49.568230 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-115c65de-42b0-4d63-983d-4ce14a9c1612 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:49.575458 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-115c65de-42b0-4d63-983d-4ce14a9c1612 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1314 microversion: 2.1 time: 0.356235 Jan 19 13:07:49.576036 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 301/597] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:49 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:49.592120 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-06132968-06b9-41f6-9985-d2be25ed2e0b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:49.600857 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-06132968-06b9-41f6-9985-d2be25ed2e0b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1555 microversion: 2.1 time: 0.370813 Jan 19 13:07:49.601500 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 297/598] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:49 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1555 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:49.980560 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1370611244", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-610852009", "security_groups": [{"name": "tempest-secgroup-smoke-1976770725"}], "networks": [{"uuid": "a1b91c13-fa70-46e4-aa28-62a3df7feef9"}], "block_device_mapping_v2": [{"uuid": "592254cf-3ba0-4153-8f81-a8ce42e2f570", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:50.087200 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.network.neutron [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] validate_networks() for [('a1b91c13-fa70-46e4-aa28-62a3df7feef9', None, None, None, None, None)] {{(pid=116361) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:07:50.229943 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-50cfdc6e-ca0a-4638-a87a-fe7d5114acd6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:50.230860 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-50cfdc6e-ca0a-4638-a87a-fe7d5114acd6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:50.240186 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50cfdc6e-ca0a-4638-a87a-fe7d5114acd6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:50.240726 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50cfdc6e-ca0a-4638-a87a-fe7d5114acd6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:50.241604 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50cfdc6e-ca0a-4638-a87a-fe7d5114acd6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:50.242085 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50cfdc6e-ca0a-4638-a87a-fe7d5114acd6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:50.439948 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Flavor limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:07:50.440564 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Image limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:07:50.440912 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Flavor pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:07:50.441347 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Image pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:07:50.441787 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:07:50.450183 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:50.450626 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:50.451425 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:50.451855 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:50.468055 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Getting quotas for project d3cd5c7acaf1414c83c725421fc4f289. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:07:50.472444 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Getting quotas for user b78c8c1e6a2e47258c251260283d8314 and project d3cd5c7acaf1414c83c725421fc4f289. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:07:50.525987 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Going to run 1 instances... {{(pid=116361) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:07:50.528122 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='592254cf-3ba0-4153-8f81-a8ce42e2f570',volume_size=None,volume_type=None)] {{(pid=116361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:07:50.648229 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-582f0166-31fd-40dc-b9aa-0f3c9ff22641 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.671193 Jan 19 13:07:50.648862 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 302/599] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:07:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:07:50.653221 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-16b9608a-7c3e-4f6b-9a45-f077dcaa84a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:50.654457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-16b9608a-7c3e-4f6b-9a45-f077dcaa84a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:50.660978 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-16b9608a-7c3e-4f6b-9a45-f077dcaa84a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:50.661430 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-16b9608a-7c3e-4f6b-9a45-f077dcaa84a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:50.662216 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-16b9608a-7c3e-4f6b-9a45-f077dcaa84a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:50.663291 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-16b9608a-7c3e-4f6b-9a45-f077dcaa84a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:54.611448 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-50cfdc6e-ca0a-4638-a87a-fe7d5114acd6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 4.384967 Jan 19 13:07:54.612746 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 298/600] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:50 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 4387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:07:54.617878 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-8e1d67f9-60d1-42ce-9304-808c07f0a756 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:54.618586 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-8e1d67f9-60d1-42ce-9304-808c07f0a756 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:54.619118 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-16b9608a-7c3e-4f6b-9a45-f077dcaa84a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 3.969028 Jan 19 13:07:54.622939 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 303/601] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:50 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 3970 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:54.625632 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a23c9175-d94b-4345-9341-811d1cf213dd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:54.625789 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8e1d67f9-60d1-42ce-9304-808c07f0a756 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:54.626082 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8e1d67f9-60d1-42ce-9304-808c07f0a756 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:54.626327 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a23c9175-d94b-4345-9341-811d1cf213dd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:54.626873 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8e1d67f9-60d1-42ce-9304-808c07f0a756 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:54.627312 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8e1d67f9-60d1-42ce-9304-808c07f0a756 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:54.634884 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a23c9175-d94b-4345-9341-811d1cf213dd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:54.635343 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a23c9175-d94b-4345-9341-811d1cf213dd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:54.636412 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a23c9175-d94b-4345-9341-811d1cf213dd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:54.637063 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a23c9175-d94b-4345-9341-811d1cf213dd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:54.836474 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-8e1d67f9-60d1-42ce-9304-808c07f0a756 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:54.843930 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-8e1d67f9-60d1-42ce-9304-808c07f0a756 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1314 microversion: 2.1 time: 0.230022 Jan 19 13:07:54.844527 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 299/602] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:54 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:54.844660 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-a23c9175-d94b-4345-9341-811d1cf213dd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:54.850183 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c70fb18d-4706-4774-af2b-26384e65b24a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:54.851157 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c70fb18d-4706-4774-af2b-26384e65b24a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:54.853416 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a23c9175-d94b-4345-9341-811d1cf213dd tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1555 microversion: 2.1 time: 0.232345 Jan 19 13:07:54.854793 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 304/603] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:54 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1555 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:54.857770 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c70fb18d-4706-4774-af2b-26384e65b24a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:54.858403 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c70fb18d-4706-4774-af2b-26384e65b24a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:54.859601 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c70fb18d-4706-4774-af2b-26384e65b24a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:54.860241 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c70fb18d-4706-4774-af2b-26384e65b24a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:54.927316 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c70fb18d-4706-4774-af2b-26384e65b24a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:54.935150 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c70fb18d-4706-4774-af2b-26384e65b24a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1186 microversion: 2.1 time: 0.089699 Jan 19 13:07:54.935709 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 300/604] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:54 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:55.622697 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-13e2ef7c-4e50-44f3-a0a8-346de326f376 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:55.623747 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-13e2ef7c-4e50-44f3-a0a8-346de326f376 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:55.631102 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ff682777-ed8d-4ced-9a32-c3853382476b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:55.631631 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13e2ef7c-4e50-44f3-a0a8-346de326f376 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:55.631631 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13e2ef7c-4e50-44f3-a0a8-346de326f376 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:55.632150 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ff682777-ed8d-4ced-9a32-c3853382476b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:55.632365 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13e2ef7c-4e50-44f3-a0a8-346de326f376 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:55.632813 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13e2ef7c-4e50-44f3-a0a8-346de326f376 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:55.638890 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff682777-ed8d-4ced-9a32-c3853382476b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:55.639425 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff682777-ed8d-4ced-9a32-c3853382476b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:55.640321 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff682777-ed8d-4ced-9a32-c3853382476b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:55.640830 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff682777-ed8d-4ced-9a32-c3853382476b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:55.707833 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-13e2ef7c-4e50-44f3-a0a8-346de326f376 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.088697 Jan 19 13:07:55.711846 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 305/605] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:55 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:55.747905 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ff682777-ed8d-4ced-9a32-c3853382476b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.121080 Jan 19 13:07:55.748998 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 301/606] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:55 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:07:55.866338 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0bc0a488-e916-43af-a150-65aedcde7cc7 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:55.867527 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0bc0a488-e916-43af-a150-65aedcde7cc7 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:55.871526 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-947a1550-0b4a-466a-8c6c-ad944265d58f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:55.872088 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-947a1550-0b4a-466a-8c6c-ad944265d58f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:55.881365 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-947a1550-0b4a-466a-8c6c-ad944265d58f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:55.882474 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-947a1550-0b4a-466a-8c6c-ad944265d58f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:55.883443 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-947a1550-0b4a-466a-8c6c-ad944265d58f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:55.883570 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0bc0a488-e916-43af-a150-65aedcde7cc7 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:55.883889 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-947a1550-0b4a-466a-8c6c-ad944265d58f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:55.884034 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0bc0a488-e916-43af-a150-65aedcde7cc7 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:55.885588 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0bc0a488-e916-43af-a150-65aedcde7cc7 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:55.886756 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0bc0a488-e916-43af-a150-65aedcde7cc7 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:56.420423 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-947a1550-0b4a-466a-8c6c-ad944265d58f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:56.429227 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-947a1550-0b4a-466a-8c6c-ad944265d58f tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1555 microversion: 2.1 time: 0.562205 Jan 19 13:07:56.430117 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 302/607] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:55 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1555 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:07:56.434372 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0487c44d-c723-4c78-8861-8fac354aea45 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:56.434975 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0487c44d-c723-4c78-8861-8fac354aea45 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:56.440022 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0bc0a488-e916-43af-a150-65aedcde7cc7 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:56.441202 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0487c44d-c723-4c78-8861-8fac354aea45 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:56.441652 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0487c44d-c723-4c78-8861-8fac354aea45 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:56.442429 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0487c44d-c723-4c78-8861-8fac354aea45 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:56.442859 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0487c44d-c723-4c78-8861-8fac354aea45 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:56.448250 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0bc0a488-e916-43af-a150-65aedcde7cc7 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1463 microversion: 2.1 time: 0.590905 Jan 19 13:07:56.448830 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 306/608] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:55 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1463 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:56.491185 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d99f666d-702d-4554-8658-30612c65e1c9 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:56.491694 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d99f666d-702d-4554-8658-30612c65e1c9 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:56.497451 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d99f666d-702d-4554-8658-30612c65e1c9 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:56.497899 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d99f666d-702d-4554-8658-30612c65e1c9 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:56.498677 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d99f666d-702d-4554-8658-30612c65e1c9 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:56.499113 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d99f666d-702d-4554-8658-30612c65e1c9 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:56.524379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d99f666d-702d-4554-8658-30612c65e1c9 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Going to try to terminate instance {{(pid=116361) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:07:56.599370 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d99f666d-702d-4554-8658-30612c65e1c9 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "DELETE /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 204 len: 0 microversion: 2.1 time: 0.113060 Jan 19 13:07:56.600073 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 307/609] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:07:56 2022] DELETE /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 13:07:56.608912 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-da28844e-326d-467a-9ccf-9044c7bcef1a tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:56.609608 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-da28844e-326d-467a-9ccf-9044c7bcef1a tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:56.617327 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-da28844e-326d-467a-9ccf-9044c7bcef1a tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:56.617951 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-da28844e-326d-467a-9ccf-9044c7bcef1a tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:56.618758 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-da28844e-326d-467a-9ccf-9044c7bcef1a tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:56.619197 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-da28844e-326d-467a-9ccf-9044c7bcef1a tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:56.749431 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0487c44d-c723-4c78-8861-8fac354aea45 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:56.759458 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0487c44d-c723-4c78-8861-8fac354aea45 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1260 microversion: 2.1 time: 0.328134 Jan 19 13:07:56.760142 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 303/610] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:56 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1260 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:56.764983 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9b80e8ff-006a-4796-b8b8-f26b54323dc6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:56.766195 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9b80e8ff-006a-4796-b8b8-f26b54323dc6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:56.792303 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9b80e8ff-006a-4796-b8b8-f26b54323dc6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:56.792871 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9b80e8ff-006a-4796-b8b8-f26b54323dc6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:56.793546 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9b80e8ff-006a-4796-b8b8-f26b54323dc6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:56.793983 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9b80e8ff-006a-4796-b8b8-f26b54323dc6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:56.864864 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-da28844e-326d-467a-9ccf-9044c7bcef1a tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:56.872381 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9b80e8ff-006a-4796-b8b8-f26b54323dc6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.110635 Jan 19 13:07:56.872946 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-da28844e-326d-467a-9ccf-9044c7bcef1a tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1469 microversion: 2.1 time: 0.268208 Jan 19 13:07:56.873829 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 308/611] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:56 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1469 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:07:56.874396 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 304/612] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:56 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:07:56.879108 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-288c3762-9ebc-4ca6-a91a-009282c95b72 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:56.880287 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-288c3762-9ebc-4ca6-a91a-009282c95b72 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:56.889016 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-288c3762-9ebc-4ca6-a91a-009282c95b72 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:56.889594 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-288c3762-9ebc-4ca6-a91a-009282c95b72 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:56.890491 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-288c3762-9ebc-4ca6-a91a-009282c95b72 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:56.891018 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-288c3762-9ebc-4ca6-a91a-009282c95b72 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:57.149799 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-288c3762-9ebc-4ca6-a91a-009282c95b72 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.274402 Jan 19 13:07:57.150689 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 309/613] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:56 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:07:57.155749 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-01e14b5e-40df-4c61-bc1b-75389acf5983 req-6b70c764-9dc6-4aa2-8d3b-2da897dc41d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ec4c20-aa67-4eef-b593-0387c00a3684", "tag": "d543cda5-e012-413e-a613-191a01247465"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:57.158374 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:07:57.158374 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:07:57.168026 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-01e14b5e-40df-4c61-bc1b-75389acf5983 req-6b70c764-9dc6-4aa2-8d3b-2da897dc41d4 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:57.168765 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-01e14b5e-40df-4c61-bc1b-75389acf5983 req-6b70c764-9dc6-4aa2-8d3b-2da897dc41d4 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:57.191623 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-01e14b5e-40df-4c61-bc1b-75389acf5983 req-6b70c764-9dc6-4aa2-8d3b-2da897dc41d4 service nova] Creating event network-changed:d543cda5-e012-413e-a613-191a01247465 for instance f7ec4c20-aa67-4eef-b593-0387c00a3684 on hv-cinder-82301 Jan 19 13:07:57.196612 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-01e14b5e-40df-4c61-bc1b-75389acf5983 req-6b70c764-9dc6-4aa2-8d3b-2da897dc41d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050549 Jan 19 13:07:57.197250 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 305/614] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:07:57.447190 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c3290213-2743-4f47-9686-8a94c46ed446 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:57.447869 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c3290213-2743-4f47-9686-8a94c46ed446 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:57.454604 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c3290213-2743-4f47-9686-8a94c46ed446 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:57.455042 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c3290213-2743-4f47-9686-8a94c46ed446 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:57.455901 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c3290213-2743-4f47-9686-8a94c46ed446 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:57.455901 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c3290213-2743-4f47-9686-8a94c46ed446 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:57.583819 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-c3290213-2743-4f47-9686-8a94c46ed446 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:57.591898 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c3290213-2743-4f47-9686-8a94c46ed446 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1555 microversion: 2.1 time: 0.148940 Jan 19 13:07:57.592479 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 310/615] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:57 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:07:57.778095 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-875c3aba-6cad-4d0d-a0fa-642f1bba6d94 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:57.778783 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-875c3aba-6cad-4d0d-a0fa-642f1bba6d94 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:57.786089 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-875c3aba-6cad-4d0d-a0fa-642f1bba6d94 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:57.786481 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-875c3aba-6cad-4d0d-a0fa-642f1bba6d94 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:57.787257 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-875c3aba-6cad-4d0d-a0fa-642f1bba6d94 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:57.787695 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-875c3aba-6cad-4d0d-a0fa-642f1bba6d94 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:57.884896 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-23a36831-22d3-4fb3-bccf-c266774838a2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:57.885802 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-23a36831-22d3-4fb3-bccf-c266774838a2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:57.892238 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-23a36831-22d3-4fb3-bccf-c266774838a2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:57.892682 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-23a36831-22d3-4fb3-bccf-c266774838a2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:57.893567 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-23a36831-22d3-4fb3-bccf-c266774838a2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:57.894024 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-23a36831-22d3-4fb3-bccf-c266774838a2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:57.926665 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-875c3aba-6cad-4d0d-a0fa-642f1bba6d94 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:57.934158 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-875c3aba-6cad-4d0d-a0fa-642f1bba6d94 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1260 microversion: 2.1 time: 0.160539 Jan 19 13:07:57.934761 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 306/616] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:57 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:57.938930 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7e53dcdc-1195-4592-9dcd-7f55ec037bd0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:07:57.939528 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7e53dcdc-1195-4592-9dcd-7f55ec037bd0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:57.945306 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7e53dcdc-1195-4592-9dcd-7f55ec037bd0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:57.945761 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7e53dcdc-1195-4592-9dcd-7f55ec037bd0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:57.946543 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7e53dcdc-1195-4592-9dcd-7f55ec037bd0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:57.946982 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7e53dcdc-1195-4592-9dcd-7f55ec037bd0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:58.073972 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7e53dcdc-1195-4592-9dcd-7f55ec037bd0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:07:58.082178 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7e53dcdc-1195-4592-9dcd-7f55ec037bd0 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1469 microversion: 2.1 time: 0.146301 Jan 19 13:07:58.082733 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 307/617] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:07:57 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1469 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:07:58.162014 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-eab50b58-3561-4020-aebc-4a2e0adab101 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:07:58.162926 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-eab50b58-3561-4020-aebc-4a2e0adab101 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:07:58.168778 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-eab50b58-3561-4020-aebc-4a2e0adab101 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:58.169236 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-eab50b58-3561-4020-aebc-4a2e0adab101 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:07:58.170016 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-eab50b58-3561-4020-aebc-4a2e0adab101 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:07:58.170462 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-eab50b58-3561-4020-aebc-4a2e0adab101 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:01.703556 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-23a36831-22d3-4fb3-bccf-c266774838a2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 3.822083 Jan 19 13:08:01.704267 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 311/618] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:07:57 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 3824 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:08:01.710356 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1e9cc98c-4154-4494-bbee-dc0808d12363 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:01.711107 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1e9cc98c-4154-4494-bbee-dc0808d12363 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:01.715375 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-eab50b58-3561-4020-aebc-4a2e0adab101 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 3.556762 Jan 19 13:08:01.716474 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 308/619] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:07:58 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 3558 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:08:01.718161 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1e9cc98c-4154-4494-bbee-dc0808d12363 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:01.718615 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1e9cc98c-4154-4494-bbee-dc0808d12363 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:01.719416 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1e9cc98c-4154-4494-bbee-dc0808d12363 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:01.720008 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1e9cc98c-4154-4494-bbee-dc0808d12363 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:01.722151 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-14d3369c-ca18-47db-8c89-7df2b7c2a469 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:01.723809 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-14d3369c-ca18-47db-8c89-7df2b7c2a469 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:01.731845 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-14d3369c-ca18-47db-8c89-7df2b7c2a469 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:01.732325 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-14d3369c-ca18-47db-8c89-7df2b7c2a469 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:01.733115 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-14d3369c-ca18-47db-8c89-7df2b7c2a469 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:01.733732 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-14d3369c-ca18-47db-8c89-7df2b7c2a469 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:02.018002 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-1e9cc98c-4154-4494-bbee-dc0808d12363 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:02.026525 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1e9cc98c-4154-4494-bbee-dc0808d12363 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1555 microversion: 2.1 time: 0.321117 Jan 19 13:08:02.026855 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-14d3369c-ca18-47db-8c89-7df2b7c2a469 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:02.032080 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 312/620] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:01 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1555 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:02.032080 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9cb43cfc-58cf-4e3f-8437-08e7338506ac tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:02.032795 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9cb43cfc-58cf-4e3f-8437-08e7338506ac tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:02.035251 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-14d3369c-ca18-47db-8c89-7df2b7c2a469 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1260 microversion: 2.1 time: 0.317392 Jan 19 13:08:02.036066 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 309/621] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:01 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1260 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:02.038612 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9cb43cfc-58cf-4e3f-8437-08e7338506ac tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:02.039071 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9cb43cfc-58cf-4e3f-8437-08e7338506ac tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:02.039875 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9cb43cfc-58cf-4e3f-8437-08e7338506ac tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:02.040349 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9cb43cfc-58cf-4e3f-8437-08e7338506ac tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:02.250068 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-9cb43cfc-58cf-4e3f-8437-08e7338506ac tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:02.258268 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9cb43cfc-58cf-4e3f-8437-08e7338506ac tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1469 microversion: 2.1 time: 0.229747 Jan 19 13:08:02.258837 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 313/622] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:02 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1469 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:02.716509 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2235da5e-e08b-4361-9c06-a9920e2fd73a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:02.717347 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2235da5e-e08b-4361-9c06-a9920e2fd73a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:02.725025 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2235da5e-e08b-4361-9c06-a9920e2fd73a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:02.725485 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2235da5e-e08b-4361-9c06-a9920e2fd73a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:02.726270 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2235da5e-e08b-4361-9c06-a9920e2fd73a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:02.726714 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2235da5e-e08b-4361-9c06-a9920e2fd73a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:02.727061 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-704a939b-f4de-4cde-bb02-61c138fc5179 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:02.727991 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-704a939b-f4de-4cde-bb02-61c138fc5179 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:02.733966 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-704a939b-f4de-4cde-bb02-61c138fc5179 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:02.734294 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-704a939b-f4de-4cde-bb02-61c138fc5179 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:02.737962 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-704a939b-f4de-4cde-bb02-61c138fc5179 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:02.739058 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-704a939b-f4de-4cde-bb02-61c138fc5179 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:03.114222 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-704a939b-f4de-4cde-bb02-61c138fc5179 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.391256 Jan 19 13:08:03.115513 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 314/623] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:02 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:08:03.119192 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2235da5e-e08b-4361-9c06-a9920e2fd73a tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.406276 Jan 19 13:08:03.123082 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 310/624] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:02 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:08:03.123242 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-55db6391-ffce-421a-a8aa-6517c43280b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:03.123242 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-55db6391-ffce-421a-a8aa-6517c43280b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:03.128975 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-aadd7227-021e-4adb-ba93-abc428ad8fe5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:03.129628 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-55db6391-ffce-421a-a8aa-6517c43280b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:03.130086 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-55db6391-ffce-421a-a8aa-6517c43280b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:03.130199 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-aadd7227-021e-4adb-ba93-abc428ad8fe5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:03.130876 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-55db6391-ffce-421a-a8aa-6517c43280b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:03.131312 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-55db6391-ffce-421a-a8aa-6517c43280b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:03.137461 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aadd7227-021e-4adb-ba93-abc428ad8fe5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:03.138014 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aadd7227-021e-4adb-ba93-abc428ad8fe5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:03.138890 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aadd7227-021e-4adb-ba93-abc428ad8fe5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:03.139421 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aadd7227-021e-4adb-ba93-abc428ad8fe5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:03.336390 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-55db6391-ffce-421a-a8aa-6517c43280b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:03.343011 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-aadd7227-021e-4adb-ba93-abc428ad8fe5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:03.346009 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-55db6391-ffce-421a-a8aa-6517c43280b4 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1555 microversion: 2.1 time: 0.229004 Jan 19 13:08:03.346766 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 315/625] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:03 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1555 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:03.352604 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6fda9555-e9a7-411d-a152-fe0b49ac117b tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:03.353396 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-aadd7227-021e-4adb-ba93-abc428ad8fe5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1260 microversion: 2.1 time: 0.231552 Jan 19 13:08:03.353667 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6fda9555-e9a7-411d-a152-fe0b49ac117b tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:03.360705 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6fda9555-e9a7-411d-a152-fe0b49ac117b tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:03.361160 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6fda9555-e9a7-411d-a152-fe0b49ac117b tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:03.361962 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6fda9555-e9a7-411d-a152-fe0b49ac117b tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:03.362404 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6fda9555-e9a7-411d-a152-fe0b49ac117b tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:03.364516 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 311/626] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:03 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:03.501547 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6fda9555-e9a7-411d-a152-fe0b49ac117b tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:03.508962 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6fda9555-e9a7-411d-a152-fe0b49ac117b tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1469 microversion: 2.1 time: 0.160594 Jan 19 13:08:03.509536 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 316/627] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:03 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:04.126716 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b4bceeaf-fae8-4d3a-9dca-3a03348b7ece tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:04.128419 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b4bceeaf-fae8-4d3a-9dca-3a03348b7ece tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:04.130828 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c92e1ab6-f58f-4f5c-b6c6-40afe75203d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:04.131646 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c92e1ab6-f58f-4f5c-b6c6-40afe75203d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:04.135827 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b4bceeaf-fae8-4d3a-9dca-3a03348b7ece tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:04.136582 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b4bceeaf-fae8-4d3a-9dca-3a03348b7ece tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:04.137371 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b4bceeaf-fae8-4d3a-9dca-3a03348b7ece tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:04.137809 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b4bceeaf-fae8-4d3a-9dca-3a03348b7ece tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:04.137933 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c92e1ab6-f58f-4f5c-b6c6-40afe75203d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:04.138335 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c92e1ab6-f58f-4f5c-b6c6-40afe75203d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:04.139119 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c92e1ab6-f58f-4f5c-b6c6-40afe75203d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:04.139585 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c92e1ab6-f58f-4f5c-b6c6-40afe75203d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:04.279623 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b4bceeaf-fae8-4d3a-9dca-3a03348b7ece tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.156480 Jan 19 13:08:04.280575 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 312/628] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:04 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:08:04.288289 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c92e1ab6-f58f-4f5c-b6c6-40afe75203d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.161375 Jan 19 13:08:04.288938 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 317/629] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:04 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:08:04.367261 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ed53cc4a-b4a7-4cbc-8645-612b836553e8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:04.368141 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ed53cc4a-b4a7-4cbc-8645-612b836553e8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:04.370760 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-01d2f0b9-3c30-4ec7-9376-1d23bb6289d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:04.372413 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-01d2f0b9-3c30-4ec7-9376-1d23bb6289d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:04.375828 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ed53cc4a-b4a7-4cbc-8645-612b836553e8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:04.376455 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ed53cc4a-b4a7-4cbc-8645-612b836553e8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:04.377391 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ed53cc4a-b4a7-4cbc-8645-612b836553e8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:04.377841 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ed53cc4a-b4a7-4cbc-8645-612b836553e8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:04.380182 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-01d2f0b9-3c30-4ec7-9376-1d23bb6289d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:04.380644 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-01d2f0b9-3c30-4ec7-9376-1d23bb6289d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:04.381434 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-01d2f0b9-3c30-4ec7-9376-1d23bb6289d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:04.382056 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-01d2f0b9-3c30-4ec7-9376-1d23bb6289d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:04.576381 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ed53cc4a-b4a7-4cbc-8645-612b836553e8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:04.580687 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-01d2f0b9-3c30-4ec7-9376-1d23bb6289d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:04.584994 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ed53cc4a-b4a7-4cbc-8645-612b836553e8 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1555 microversion: 2.1 time: 0.222748 Jan 19 13:08:04.585776 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 313/630] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:04 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1555 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:04.590025 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e4e99c64-9eab-4ff5-9d40-92f7b0b04ec4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:04.590617 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e4e99c64-9eab-4ff5-9d40-92f7b0b04ec4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:04.596421 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e4e99c64-9eab-4ff5-9d40-92f7b0b04ec4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:04.596880 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e4e99c64-9eab-4ff5-9d40-92f7b0b04ec4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:04.598003 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e4e99c64-9eab-4ff5-9d40-92f7b0b04ec4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:04.598122 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-01d2f0b9-3c30-4ec7-9376-1d23bb6289d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1260 microversion: 2.1 time: 0.231129 Jan 19 13:08:04.598209 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e4e99c64-9eab-4ff5-9d40-92f7b0b04ec4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:04.598441 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 318/631] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:04 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:04.820063 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-e4e99c64-9eab-4ff5-9d40-92f7b0b04ec4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02228f6e32bf465ab08301cc170cb76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c38d411f94167b0bff8e26c9b89ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:04.827755 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e4e99c64-9eab-4ff5-9d40-92f7b0b04ec4 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 200 len: 1469 microversion: 2.1 time: 0.241230 Jan 19 13:08:04.828353 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 314/632] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:04 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 1469 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:05.125335 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-5198a928-ce55-4974-a4a5-d2490656b53a req-abf9d535-dd0f-463b-b600-63799e7d948a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "924c20fc-437f-4043-a8ee-38318a5f35c2", "name": "network-vif-deleted", "tag": "e17b8a3e-fabe-418f-ac5d-1604def05474"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:05.127150 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:08:05.127150 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:08:05.138042 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-5198a928-ce55-4974-a4a5-d2490656b53a req-abf9d535-dd0f-463b-b600-63799e7d948a service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:05.139455 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-5198a928-ce55-4974-a4a5-d2490656b53a req-abf9d535-dd0f-463b-b600-63799e7d948a service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:05.154195 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-5198a928-ce55-4974-a4a5-d2490656b53a req-abf9d535-dd0f-463b-b600-63799e7d948a service nova] Creating event network-vif-deleted:e17b8a3e-fabe-418f-ac5d-1604def05474 for instance 924c20fc-437f-4043-a8ee-38318a5f35c2 on hv-cinder-82301 Jan 19 13:08:05.159534 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-5198a928-ce55-4974-a4a5-d2490656b53a req-abf9d535-dd0f-463b-b600-63799e7d948a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037805 Jan 19 13:08:05.160696 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 319/633] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:08:05.290702 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4c67c100-02c0-45a8-b1ec-30b3dbee9961 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:05.291605 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4c67c100-02c0-45a8-b1ec-30b3dbee9961 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:05.297933 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c67c100-02c0-45a8-b1ec-30b3dbee9961 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:05.298385 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c67c100-02c0-45a8-b1ec-30b3dbee9961 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:05.299170 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c67c100-02c0-45a8-b1ec-30b3dbee9961 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:05.299612 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c67c100-02c0-45a8-b1ec-30b3dbee9961 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:05.301103 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-22658837-7dc1-4738-9732-5cf1b9bdbf31 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:05.302193 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-22658837-7dc1-4738-9732-5cf1b9bdbf31 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:05.309697 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-22658837-7dc1-4738-9732-5cf1b9bdbf31 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:05.310151 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-22658837-7dc1-4738-9732-5cf1b9bdbf31 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:05.311031 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-22658837-7dc1-4738-9732-5cf1b9bdbf31 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:05.311635 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-22658837-7dc1-4738-9732-5cf1b9bdbf31 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:05.364105 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4c67c100-02c0-45a8-b1ec-30b3dbee9961 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.076917 Jan 19 13:08:05.364964 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 315/634] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:05 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:08:05.370534 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-22658837-7dc1-4738-9732-5cf1b9bdbf31 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.074274 Jan 19 13:08:05.371168 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 320/635] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:05 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:08:05.603157 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-82ecf02b-09e7-4374-8807-51760d0ff48a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:05.603946 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-82ecf02b-09e7-4374-8807-51760d0ff48a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:05.611288 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-82ecf02b-09e7-4374-8807-51760d0ff48a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:05.611733 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-82ecf02b-09e7-4374-8807-51760d0ff48a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:05.612544 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-82ecf02b-09e7-4374-8807-51760d0ff48a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:05.613214 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-82ecf02b-09e7-4374-8807-51760d0ff48a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:05.615329 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-feda3245-b23e-4b5d-b4cc-dba30eb2d4bc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:05.616199 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-feda3245-b23e-4b5d-b4cc-dba30eb2d4bc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:05.623350 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-feda3245-b23e-4b5d-b4cc-dba30eb2d4bc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:05.624251 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-feda3245-b23e-4b5d-b4cc-dba30eb2d4bc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:05.625048 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-feda3245-b23e-4b5d-b4cc-dba30eb2d4bc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:05.625736 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-feda3245-b23e-4b5d-b4cc-dba30eb2d4bc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:05.824288 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-feda3245-b23e-4b5d-b4cc-dba30eb2d4bc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:05.832463 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-82ecf02b-09e7-4374-8807-51760d0ff48a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:05.832619 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-feda3245-b23e-4b5d-b4cc-dba30eb2d4bc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1260 microversion: 2.1 time: 0.221327 Jan 19 13:08:05.832821 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 321/636] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:05 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:05.843881 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-82ecf02b-09e7-4374-8807-51760d0ff48a tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1561 microversion: 2.1 time: 0.245474 Jan 19 13:08:05.844675 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 316/637] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:05 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1561 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:05.845706 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-52260415-a390-498a-a6c8-b1359dd5d943 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:05.846522 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-52260415-a390-498a-a6c8-b1359dd5d943 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] [instance: 924c20fc-437f-4043-a8ee-38318a5f35c2] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:05.853091 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-52260415-a390-498a-a6c8-b1359dd5d943 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:05.853556 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-52260415-a390-498a-a6c8-b1359dd5d943 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:05.854367 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-52260415-a390-498a-a6c8-b1359dd5d943 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:05.854808 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-52260415-a390-498a-a6c8-b1359dd5d943 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:05.869136 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-52260415-a390-498a-a6c8-b1359dd5d943 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] HTTP exception thrown: Instance 924c20fc-437f-4043-a8ee-38318a5f35c2 could not be found. Jan 19 13:08:05.869697 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-52260415-a390-498a-a6c8-b1359dd5d943 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] Returning 404 to user: Instance 924c20fc-437f-4043-a8ee-38318a5f35c2 could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:08:05.871539 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-52260415-a390-498a-a6c8-b1359dd5d943 tempest-VolumesNegativeTest-1386019217 tempest-VolumesNegativeTest-1386019217-project] 10.222.0.48 "GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2" status: 404 len: 111 microversion: 2.1 time: 0.028924 Jan 19 13:08:05.871539 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 322/638] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:05 2022] GET /compute/v2.1/servers/924c20fc-437f-4043-a8ee-38318a5f35c2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:08:05.926196 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2628fd73-95a4-4dc2-a9a8-132c609581ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:05.927244 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2628fd73-95a4-4dc2-a9a8-132c609581ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:05.933452 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2628fd73-95a4-4dc2-a9a8-132c609581ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:05.933903 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2628fd73-95a4-4dc2-a9a8-132c609581ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:05.934709 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2628fd73-95a4-4dc2-a9a8-132c609581ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:05.935386 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2628fd73-95a4-4dc2-a9a8-132c609581ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:06.058553 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.objects.instance [None req-2628fd73-95a4-4dc2-a9a8-132c609581ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lazy-loading 'services' on Instance uuid 9b74c954-19e1-498d-a9b6-c0fb2663635a {{(pid=116360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:08:06.178614 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2628fd73-95a4-4dc2-a9a8-132c609581ba tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/os-volume_attachments/903d8736-7abf-4e95-95cc-d3ef8a9777ff" status: 202 len: 0 microversion: 2.1 time: 0.257169 Jan 19 13:08:06.179431 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 317/639] 10.222.0.48 () {58 vars in 1415 bytes} [Wed Jan 19 13:08:05 2022] DELETE /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/os-volume_attachments/903d8736-7abf-4e95-95cc-d3ef8a9777ff => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:08:06.187413 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6d5dd6d5-9ad1-402d-a4af-9cb62c84fef0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:06.188347 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6d5dd6d5-9ad1-402d-a4af-9cb62c84fef0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:06.195404 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d5dd6d5-9ad1-402d-a4af-9cb62c84fef0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:06.195856 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d5dd6d5-9ad1-402d-a4af-9cb62c84fef0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:06.196751 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d5dd6d5-9ad1-402d-a4af-9cb62c84fef0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:06.197359 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d5dd6d5-9ad1-402d-a4af-9cb62c84fef0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:06.231746 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6d5dd6d5-9ad1-402d-a4af-9cb62c84fef0 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047996 Jan 19 13:08:06.232422 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 323/640] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:08:06 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:08:06.376950 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6ab0edb1-67c7-4d5b-8c84-3fbd2e23d4b6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:06.378002 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6ab0edb1-67c7-4d5b-8c84-3fbd2e23d4b6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:06.384308 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ab0edb1-67c7-4d5b-8c84-3fbd2e23d4b6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:06.384756 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ab0edb1-67c7-4d5b-8c84-3fbd2e23d4b6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:06.385532 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ab0edb1-67c7-4d5b-8c84-3fbd2e23d4b6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:06.385962 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ab0edb1-67c7-4d5b-8c84-3fbd2e23d4b6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:06.386481 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8896247a-ea80-45a8-aafd-6c00c538e2b7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:06.387504 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8896247a-ea80-45a8-aafd-6c00c538e2b7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:06.393444 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8896247a-ea80-45a8-aafd-6c00c538e2b7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:06.394058 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8896247a-ea80-45a8-aafd-6c00c538e2b7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:06.395281 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8896247a-ea80-45a8-aafd-6c00c538e2b7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:06.396031 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8896247a-ea80-45a8-aafd-6c00c538e2b7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:06.491899 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6ab0edb1-67c7-4d5b-8c84-3fbd2e23d4b6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 28626 microversion: 2.20 time: 0.119262 Jan 19 13:08:06.495828 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 318/641] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:06 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 28626 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:08:06.496009 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8896247a-ea80-45a8-aafd-6c00c538e2b7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.113849 Jan 19 13:08:06.496009 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 324/642] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:06 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:08:06.850774 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5d0b1d8f-c42e-4864-88ad-3ca61560d0fe tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:06.851655 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5d0b1d8f-c42e-4864-88ad-3ca61560d0fe tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:06.859134 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5d0b1d8f-c42e-4864-88ad-3ca61560d0fe tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:06.859702 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5d0b1d8f-c42e-4864-88ad-3ca61560d0fe tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:06.860788 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5d0b1d8f-c42e-4864-88ad-3ca61560d0fe tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:06.861334 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5d0b1d8f-c42e-4864-88ad-3ca61560d0fe tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:07.053113 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5d0b1d8f-c42e-4864-88ad-3ca61560d0fe tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:07.061284 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5d0b1d8f-c42e-4864-88ad-3ca61560d0fe tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1260 microversion: 2.1 time: 0.216185 Jan 19 13:08:07.062187 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 325/643] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:06 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:07.246603 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e7a8af19-be02-4b52-bb73-9d750614d8bb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:07.249051 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e7a8af19-be02-4b52-bb73-9d750614d8bb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:07.258565 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e7a8af19-be02-4b52-bb73-9d750614d8bb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:07.259262 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e7a8af19-be02-4b52-bb73-9d750614d8bb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:07.260244 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e7a8af19-be02-4b52-bb73-9d750614d8bb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:07.260863 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e7a8af19-be02-4b52-bb73-9d750614d8bb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:07.303820 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e7a8af19-be02-4b52-bb73-9d750614d8bb tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063595 Jan 19 13:08:07.304647 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 319/644] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:08:07 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:08:07.503112 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a34ddf59-9794-439c-8b6c-801a138510d4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:07.504918 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a34ddf59-9794-439c-8b6c-801a138510d4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:07.506736 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c1677de7-d9a7-46d4-ad10-cd8c149e6292 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:07.508126 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c1677de7-d9a7-46d4-ad10-cd8c149e6292 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:07.512983 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a34ddf59-9794-439c-8b6c-801a138510d4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:07.513673 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a34ddf59-9794-439c-8b6c-801a138510d4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:07.514713 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a34ddf59-9794-439c-8b6c-801a138510d4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:07.515154 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a34ddf59-9794-439c-8b6c-801a138510d4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:07.516873 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c1677de7-d9a7-46d4-ad10-cd8c149e6292 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:07.517332 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c1677de7-d9a7-46d4-ad10-cd8c149e6292 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:07.518277 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c1677de7-d9a7-46d4-ad10-cd8c149e6292 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:07.518882 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c1677de7-d9a7-46d4-ad10-cd8c149e6292 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:07.617759 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a34ddf59-9794-439c-8b6c-801a138510d4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 30066 microversion: 2.20 time: 0.118663 Jan 19 13:08:07.620011 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 326/645] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:07 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 30066 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:08:07.633743 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c1677de7-d9a7-46d4-ad10-cd8c149e6292 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28652 microversion: 2.1 time: 0.130673 Jan 19 13:08:07.634790 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 320/646] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:07 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28652 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:08:08.079290 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6268d282-1ee2-4162-822b-3e7692ca6674 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:08.080999 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6268d282-1ee2-4162-822b-3e7692ca6674 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:08.090472 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6268d282-1ee2-4162-822b-3e7692ca6674 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:08.090836 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6268d282-1ee2-4162-822b-3e7692ca6674 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:08.091772 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6268d282-1ee2-4162-822b-3e7692ca6674 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:08.092738 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6268d282-1ee2-4162-822b-3e7692ca6674 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:08.275858 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6268d282-1ee2-4162-822b-3e7692ca6674 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:08.290373 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6268d282-1ee2-4162-822b-3e7692ca6674 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1260 microversion: 2.1 time: 0.215378 Jan 19 13:08:08.291215 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 327/647] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:08 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:08.633022 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-aa8d0b82-36a9-4a59-9e18-3b52d265089f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:08.635672 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-aa8d0b82-36a9-4a59-9e18-3b52d265089f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:08.648292 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-32bce24f-36dc-44ad-8d8f-796307442bd2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:08.648878 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa8d0b82-36a9-4a59-9e18-3b52d265089f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:08.650014 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-32bce24f-36dc-44ad-8d8f-796307442bd2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:08.650162 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa8d0b82-36a9-4a59-9e18-3b52d265089f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:08.650849 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa8d0b82-36a9-4a59-9e18-3b52d265089f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:08.651663 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa8d0b82-36a9-4a59-9e18-3b52d265089f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:08.662833 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32bce24f-36dc-44ad-8d8f-796307442bd2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:08.663510 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32bce24f-36dc-44ad-8d8f-796307442bd2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:08.666391 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32bce24f-36dc-44ad-8d8f-796307442bd2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:08.666798 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32bce24f-36dc-44ad-8d8f-796307442bd2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:08.759901 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-aa8d0b82-36a9-4a59-9e18-3b52d265089f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 31619 microversion: 2.20 time: 0.133295 Jan 19 13:08:08.761645 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 321/648] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:08 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 31619 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:08:08.798261 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-32bce24f-36dc-44ad-8d8f-796307442bd2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 28771 microversion: 2.1 time: 0.155247 Jan 19 13:08:08.799303 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 328/649] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:08 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 28771 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:08:09.306909 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-58c54d56-daf1-4c68-a6a5-7812d3838dc2 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:09.307610 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-58c54d56-daf1-4c68-a6a5-7812d3838dc2 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:09.314550 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-58c54d56-daf1-4c68-a6a5-7812d3838dc2 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:09.315011 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-58c54d56-daf1-4c68-a6a5-7812d3838dc2 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:09.316835 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-58c54d56-daf1-4c68-a6a5-7812d3838dc2 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:09.317352 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-58c54d56-daf1-4c68-a6a5-7812d3838dc2 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:09.453940 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-58c54d56-daf1-4c68-a6a5-7812d3838dc2 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:09.462210 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-58c54d56-daf1-4c68-a6a5-7812d3838dc2 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1260 microversion: 2.1 time: 0.159216 Jan 19 13:08:09.462777 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 322/650] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:09 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:09.773469 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c4c7ff8a-23fb-4063-97f7-715d14d02ee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:09.774472 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c4c7ff8a-23fb-4063-97f7-715d14d02ee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:09.781962 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c4c7ff8a-23fb-4063-97f7-715d14d02ee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:09.782849 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c4c7ff8a-23fb-4063-97f7-715d14d02ee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:09.783186 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c4c7ff8a-23fb-4063-97f7-715d14d02ee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:09.783616 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c4c7ff8a-23fb-4063-97f7-715d14d02ee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:09.815698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f60a2211-4e41-4746-a9bd-f094985dcb31 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:09.820672 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f60a2211-4e41-4746-a9bd-f094985dcb31 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:09.833156 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f60a2211-4e41-4746-a9bd-f094985dcb31 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:09.833612 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f60a2211-4e41-4746-a9bd-f094985dcb31 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:09.834426 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f60a2211-4e41-4746-a9bd-f094985dcb31 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:09.834870 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f60a2211-4e41-4746-a9bd-f094985dcb31 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:09.869665 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c4c7ff8a-23fb-4063-97f7-715d14d02ee5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 32742 microversion: 2.20 time: 0.100677 Jan 19 13:08:09.875823 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 329/651] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:09 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 32742 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:08:09.895566 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5ef30e39-0c85-4c94-83d8-e55c8ebc85e5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:09.896184 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5ef30e39-0c85-4c94-83d8-e55c8ebc85e5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:09.902763 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5ef30e39-0c85-4c94-83d8-e55c8ebc85e5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:09.903272 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5ef30e39-0c85-4c94-83d8-e55c8ebc85e5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:09.904038 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5ef30e39-0c85-4c94-83d8-e55c8ebc85e5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:09.904546 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5ef30e39-0c85-4c94-83d8-e55c8ebc85e5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:09.932802 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5ef30e39-0c85-4c94-83d8-e55c8ebc85e5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Going to try to terminate instance {{(pid=116361) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:08:09.980651 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f60a2211-4e41-4746-a9bd-f094985dcb31 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 29853 microversion: 2.1 time: 0.172462 Jan 19 13:08:09.984161 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 323/652] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:09 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 29853 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:08:10.046348 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5ef30e39-0c85-4c94-83d8-e55c8ebc85e5 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 204 len: 0 microversion: 2.1 time: 0.168642 Jan 19 13:08:10.047607 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 330/653] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:08:09 2022] DELETE /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:08:10.057693 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-276ed84e-a1ff-410d-b2ea-3acd0fc42c48 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:10.058575 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-276ed84e-a1ff-410d-b2ea-3acd0fc42c48 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:10.068684 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-276ed84e-a1ff-410d-b2ea-3acd0fc42c48 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:10.069257 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-276ed84e-a1ff-410d-b2ea-3acd0fc42c48 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:10.070152 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-276ed84e-a1ff-410d-b2ea-3acd0fc42c48 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:10.070769 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-276ed84e-a1ff-410d-b2ea-3acd0fc42c48 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:10.323688 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-276ed84e-a1ff-410d-b2ea-3acd0fc42c48 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:10.333120 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-276ed84e-a1ff-410d-b2ea-3acd0fc42c48 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1508 microversion: 2.1 time: 0.279922 Jan 19 13:08:10.334417 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 324/654] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:10 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:10.479771 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-abb53642-0e54-4a45-85da-d6e57530f537 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:10.481183 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-abb53642-0e54-4a45-85da-d6e57530f537 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:10.489615 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-abb53642-0e54-4a45-85da-d6e57530f537 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:10.490618 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-abb53642-0e54-4a45-85da-d6e57530f537 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:10.491889 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-abb53642-0e54-4a45-85da-d6e57530f537 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:10.496649 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-abb53642-0e54-4a45-85da-d6e57530f537 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:10.827297 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-abb53642-0e54-4a45-85da-d6e57530f537 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:10.842772 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-abb53642-0e54-4a45-85da-d6e57530f537 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1260 microversion: 2.1 time: 0.367677 Jan 19 13:08:10.843814 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 331/655] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:10 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1260 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:10.889857 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-bcf63424-4cd1-4bbb-9225-06451378111d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:10.890837 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-bcf63424-4cd1-4bbb-9225-06451378111d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:10.900964 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bcf63424-4cd1-4bbb-9225-06451378111d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:10.901808 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bcf63424-4cd1-4bbb-9225-06451378111d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:10.902827 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bcf63424-4cd1-4bbb-9225-06451378111d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:10.903519 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bcf63424-4cd1-4bbb-9225-06451378111d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:10.995398 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-614988bb-8562-4883-b422-d0a1c1d332c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:10.996669 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-614988bb-8562-4883-b422-d0a1c1d332c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:11.008103 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-614988bb-8562-4883-b422-d0a1c1d332c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:11.008963 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-614988bb-8562-4883-b422-d0a1c1d332c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:11.009994 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-614988bb-8562-4883-b422-d0a1c1d332c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:11.010655 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-614988bb-8562-4883-b422-d0a1c1d332c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:11.017332 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-bcf63424-4cd1-4bbb-9225-06451378111d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 33198 microversion: 2.20 time: 0.132325 Jan 19 13:08:11.022194 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 325/656] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:10 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 33198 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:08:11.107595 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-614988bb-8562-4883-b422-d0a1c1d332c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 30938 microversion: 2.1 time: 0.116728 Jan 19 13:08:11.108687 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 332/657] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:10 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 30938 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:08:11.356528 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-270a3821-7a61-48f5-a3b5-ad8ac73116ee tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:11.357301 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-270a3821-7a61-48f5-a3b5-ad8ac73116ee tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:11.390658 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-270a3821-7a61-48f5-a3b5-ad8ac73116ee tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:11.391127 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-270a3821-7a61-48f5-a3b5-ad8ac73116ee tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:11.391944 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-270a3821-7a61-48f5-a3b5-ad8ac73116ee tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:11.396024 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-270a3821-7a61-48f5-a3b5-ad8ac73116ee tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:11.634586 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-270a3821-7a61-48f5-a3b5-ad8ac73116ee tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:11.643525 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-270a3821-7a61-48f5-a3b5-ad8ac73116ee tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1508 microversion: 2.1 time: 0.296263 Jan 19 13:08:11.645240 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 326/658] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:11 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1508 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:11.860856 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7c9d7268-cd3b-4afa-8697-1c37dbd8c1dc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:11.862128 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7c9d7268-cd3b-4afa-8697-1c37dbd8c1dc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:11.871566 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7c9d7268-cd3b-4afa-8697-1c37dbd8c1dc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:11.884825 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7c9d7268-cd3b-4afa-8697-1c37dbd8c1dc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:11.885682 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7c9d7268-cd3b-4afa-8697-1c37dbd8c1dc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:11.886379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7c9d7268-cd3b-4afa-8697-1c37dbd8c1dc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:12.033338 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6a34de13-270d-4359-bf50-e42021d3fc91 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:12.038365 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6a34de13-270d-4359-bf50-e42021d3fc91 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:12.049001 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6a34de13-270d-4359-bf50-e42021d3fc91 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:12.049793 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6a34de13-270d-4359-bf50-e42021d3fc91 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:12.052234 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6a34de13-270d-4359-bf50-e42021d3fc91 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:12.052959 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6a34de13-270d-4359-bf50-e42021d3fc91 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:12.183331 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6a34de13-270d-4359-bf50-e42021d3fc91 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 33619 microversion: 2.20 time: 0.155154 Jan 19 13:08:12.188573 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 327/659] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:12 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 33619 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:08:12.195625 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-03422ad8-af82-4f66-b814-d289f94a36ca tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:12.196897 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-03422ad8-af82-4f66-b814-d289f94a36ca tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:12.205302 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-03422ad8-af82-4f66-b814-d289f94a36ca tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:12.207058 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-03422ad8-af82-4f66-b814-d289f94a36ca tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:12.208733 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-03422ad8-af82-4f66-b814-d289f94a36ca tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:12.209341 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-03422ad8-af82-4f66-b814-d289f94a36ca tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:12.318098 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-7c9d7268-cd3b-4afa-8697-1c37dbd8c1dc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:12.334077 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-03422ad8-af82-4f66-b814-d289f94a36ca tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 32217 microversion: 2.1 time: 0.143758 Jan 19 13:08:12.337498 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 328/660] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:12 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 32217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:08:12.338463 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7c9d7268-cd3b-4afa-8697-1c37dbd8c1dc tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1260 microversion: 2.1 time: 0.481457 Jan 19 13:08:12.350119 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 333/661] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:11 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1260 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:12.661907 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-feeb4107-bd76-45c5-9465-e5f11f9c937b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:12.662614 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-feeb4107-bd76-45c5-9465-e5f11f9c937b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:12.669560 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-feeb4107-bd76-45c5-9465-e5f11f9c937b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:12.670329 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-feeb4107-bd76-45c5-9465-e5f11f9c937b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:12.671285 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-feeb4107-bd76-45c5-9465-e5f11f9c937b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:12.671893 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-feeb4107-bd76-45c5-9465-e5f11f9c937b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:12.943927 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-feeb4107-bd76-45c5-9465-e5f11f9c937b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:12.952314 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-feeb4107-bd76-45c5-9465-e5f11f9c937b tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1508 microversion: 2.1 time: 0.294789 Jan 19 13:08:12.956156 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 329/662] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:12 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1508 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:13.196772 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-cb204825-e330-489c-aad5-763a6ab53b87 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:13.198575 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-cb204825-e330-489c-aad5-763a6ab53b87 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:13.208752 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cb204825-e330-489c-aad5-763a6ab53b87 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:13.209380 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cb204825-e330-489c-aad5-763a6ab53b87 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:13.210349 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cb204825-e330-489c-aad5-763a6ab53b87 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:13.210945 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cb204825-e330-489c-aad5-763a6ab53b87 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:13.290296 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-cb204825-e330-489c-aad5-763a6ab53b87 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 34505 microversion: 2.20 time: 0.099102 Jan 19 13:08:13.291644 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 334/663] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:13 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 34505 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:08:13.349579 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f6e83f23-b0f1-42e7-a41b-2ed776824001 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:13.353005 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f6e83f23-b0f1-42e7-a41b-2ed776824001 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:13.357422 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-220acd6b-c363-4c16-951d-ef66cfff82e4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:13.358416 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-220acd6b-c363-4c16-951d-ef66cfff82e4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:13.362282 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f6e83f23-b0f1-42e7-a41b-2ed776824001 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:13.363330 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f6e83f23-b0f1-42e7-a41b-2ed776824001 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:13.369109 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-220acd6b-c363-4c16-951d-ef66cfff82e4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:13.369519 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f6e83f23-b0f1-42e7-a41b-2ed776824001 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:13.370018 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f6e83f23-b0f1-42e7-a41b-2ed776824001 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:13.370380 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-220acd6b-c363-4c16-951d-ef66cfff82e4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:13.371792 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-220acd6b-c363-4c16-951d-ef66cfff82e4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:13.372481 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-220acd6b-c363-4c16-951d-ef66cfff82e4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:13.502629 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f6e83f23-b0f1-42e7-a41b-2ed776824001 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 33330 microversion: 2.1 time: 0.157166 Jan 19 13:08:13.503669 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 330/664] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:13 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 33330 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:08:13.948994 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-220acd6b-c363-4c16-951d-ef66cfff82e4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:13.957080 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-220acd6b-c363-4c16-951d-ef66cfff82e4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1260 microversion: 2.1 time: 0.603397 Jan 19 13:08:13.957665 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 335/665] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:13 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1260 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:13.974043 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-22417ef0-a074-415c-b414-11ed1bfa571c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:13.974744 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-22417ef0-a074-415c-b414-11ed1bfa571c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:13.987526 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-22417ef0-a074-415c-b414-11ed1bfa571c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:13.988341 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-22417ef0-a074-415c-b414-11ed1bfa571c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:13.989157 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-22417ef0-a074-415c-b414-11ed1bfa571c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:13.989600 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-22417ef0-a074-415c-b414-11ed1bfa571c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:14.302975 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f8f4dbc4-0f71-4b51-a20b-ba657d6f71f3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:14.303914 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f8f4dbc4-0f71-4b51-a20b-ba657d6f71f3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:14.320346 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f8f4dbc4-0f71-4b51-a20b-ba657d6f71f3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:14.322630 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f8f4dbc4-0f71-4b51-a20b-ba657d6f71f3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:14.323720 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f8f4dbc4-0f71-4b51-a20b-ba657d6f71f3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:14.327092 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f8f4dbc4-0f71-4b51-a20b-ba657d6f71f3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:14.333336 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-22417ef0-a074-415c-b414-11ed1bfa571c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:14.348673 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-22417ef0-a074-415c-b414-11ed1bfa571c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 200 len: 1508 microversion: 2.1 time: 0.378839 Jan 19 13:08:14.349255 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 331/666] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:13 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:14.427948 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f8f4dbc4-0f71-4b51-a20b-ba657d6f71f3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 35668 microversion: 2.20 time: 0.128153 Jan 19 13:08:14.429085 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 336/667] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:14 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 35668 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:08:14.515058 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-da179a58-34c6-41a7-81c6-07646e867abd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:14.516094 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-da179a58-34c6-41a7-81c6-07646e867abd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:14.525054 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da179a58-34c6-41a7-81c6-07646e867abd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:14.525824 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da179a58-34c6-41a7-81c6-07646e867abd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:14.526816 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da179a58-34c6-41a7-81c6-07646e867abd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:14.527457 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da179a58-34c6-41a7-81c6-07646e867abd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:14.608427 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-da179a58-34c6-41a7-81c6-07646e867abd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 34096 microversion: 2.1 time: 0.097185 Jan 19 13:08:14.609084 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 332/668] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:14 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 34096 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:08:14.620151 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-6609c499-489f-43b2-a7e2-eb12e124d9a7 req-36dd0914-d9ba-4623-9276-531fa0cff747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7999cb-80e5-4ad9-aed4-efea6e23ffa7", "name": "network-vif-deleted", "tag": "958818e4-6792-4499-aa84-8ad5cc852465"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:14.625328 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:08:14.625328 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:08:14.643583 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-6609c499-489f-43b2-a7e2-eb12e124d9a7 req-36dd0914-d9ba-4623-9276-531fa0cff747 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:14.644273 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-6609c499-489f-43b2-a7e2-eb12e124d9a7 req-36dd0914-d9ba-4623-9276-531fa0cff747 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:14.675875 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-6609c499-489f-43b2-a7e2-eb12e124d9a7 req-36dd0914-d9ba-4623-9276-531fa0cff747 service nova] Creating event network-vif-deleted:958818e4-6792-4499-aa84-8ad5cc852465 for instance 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 on hv-cinder-82301 Jan 19 13:08:14.691588 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-6609c499-489f-43b2-a7e2-eb12e124d9a7 req-36dd0914-d9ba-4623-9276-531fa0cff747 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086800 Jan 19 13:08:14.692527 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 337/669] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:08:14.975765 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-aa460694-8291-4dca-aaa9-1744c8e0eafa tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:14.976543 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-aa460694-8291-4dca-aaa9-1744c8e0eafa tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:14.984221 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa460694-8291-4dca-aaa9-1744c8e0eafa tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:14.985006 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa460694-8291-4dca-aaa9-1744c8e0eafa tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:14.985884 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa460694-8291-4dca-aaa9-1744c8e0eafa tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:14.986443 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa460694-8291-4dca-aaa9-1744c8e0eafa tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:15.229022 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-aa460694-8291-4dca-aaa9-1744c8e0eafa tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:15.236784 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-aa460694-8291-4dca-aaa9-1744c8e0eafa tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1260 microversion: 2.1 time: 0.266344 Jan 19 13:08:15.238685 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 333/670] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:14 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:15.366944 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-84acb49e-be0a-4f8e-8b2a-9615dd0ea74c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:15.367662 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-84acb49e-be0a-4f8e-8b2a-9615dd0ea74c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:15.374248 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-84acb49e-be0a-4f8e-8b2a-9615dd0ea74c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:15.374696 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-84acb49e-be0a-4f8e-8b2a-9615dd0ea74c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:15.375476 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-84acb49e-be0a-4f8e-8b2a-9615dd0ea74c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:15.375916 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-84acb49e-be0a-4f8e-8b2a-9615dd0ea74c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:15.389673 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-84acb49e-be0a-4f8e-8b2a-9615dd0ea74c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] HTTP exception thrown: Instance 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 could not be found. Jan 19 13:08:15.390275 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-84acb49e-be0a-4f8e-8b2a-9615dd0ea74c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Returning 404 to user: Instance 5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:08:15.391108 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-84acb49e-be0a-4f8e-8b2a-9615dd0ea74c tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7" status: 404 len: 111 microversion: 2.1 time: 0.028808 Jan 19 13:08:15.391852 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 338/671] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:15 2022] GET /compute/v2.1/servers/5a7999cb-80e5-4ad9-aed4-efea6e23ffa7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:08:15.399421 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9a75fbce-8766-466e-8080-b480f54de216 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:15.400228 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9a75fbce-8766-466e-8080-b480f54de216 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:15.406493 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9a75fbce-8766-466e-8080-b480f54de216 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:15.406941 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9a75fbce-8766-466e-8080-b480f54de216 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:15.407911 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9a75fbce-8766-466e-8080-b480f54de216 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:15.408523 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9a75fbce-8766-466e-8080-b480f54de216 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:15.440457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-13ff1065-e191-41d4-848f-1e76fe54e63c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:15.441491 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-13ff1065-e191-41d4-848f-1e76fe54e63c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:15.444631 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9a75fbce-8766-466e-8080-b480f54de216 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Going to try to terminate instance {{(pid=116360) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:08:15.448082 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13ff1065-e191-41d4-848f-1e76fe54e63c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:15.448752 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13ff1065-e191-41d4-848f-1e76fe54e63c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:15.449703 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13ff1065-e191-41d4-848f-1e76fe54e63c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:15.450293 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13ff1065-e191-41d4-848f-1e76fe54e63c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:15.526604 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9a75fbce-8766-466e-8080-b480f54de216 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 204 len: 0 microversion: 2.1 time: 0.130490 Jan 19 13:08:15.527555 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 334/672] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:08:15 2022] DELETE /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:08:15.536672 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-1bad849e-f457-426f-83c8-ecebd71ee396 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:15.537368 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-1bad849e-f457-426f-83c8-ecebd71ee396 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:15.543658 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-13ff1065-e191-41d4-848f-1e76fe54e63c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 37043 microversion: 2.20 time: 0.106609 Jan 19 13:08:15.548303 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 339/673] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:15 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 37043 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:08:15.548447 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1bad849e-f457-426f-83c8-ecebd71ee396 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:15.548447 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1bad849e-f457-426f-83c8-ecebd71ee396 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:15.548447 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1bad849e-f457-426f-83c8-ecebd71ee396 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:15.548447 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1bad849e-f457-426f-83c8-ecebd71ee396 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:15.621463 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-83e0b59f-8218-4b01-868c-ff061cc52784 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:15.622504 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-83e0b59f-8218-4b01-868c-ff061cc52784 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:15.632770 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-83e0b59f-8218-4b01-868c-ff061cc52784 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:15.633360 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-83e0b59f-8218-4b01-868c-ff061cc52784 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:15.634186 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-83e0b59f-8218-4b01-868c-ff061cc52784 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:15.634631 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-83e0b59f-8218-4b01-868c-ff061cc52784 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:15.701324 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-1bad849e-f457-426f-83c8-ecebd71ee396 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:15.710265 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-1bad849e-f457-426f-83c8-ecebd71ee396 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 0.178212 Jan 19 13:08:15.710890 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 335/674] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:15 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:15.730973 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-83e0b59f-8218-4b01-868c-ff061cc52784 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 35115 microversion: 2.1 time: 0.113514 Jan 19 13:08:15.735254 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 340/675] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:15 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 35115 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:08:16.194820 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-82e1c24e-35bc-4093-b5d5-635ae0fb5388 req-023c7965-4b13-4df6-ad5d-fc043574a758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ec4c20-aa67-4eef-b593-0387c00a3684", "name": "network-vif-plugged", "status": "completed", "tag": "d543cda5-e012-413e-a613-191a01247465"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:16.197459 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:08:16.197459 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:08:16.214170 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-82e1c24e-35bc-4093-b5d5-635ae0fb5388 req-023c7965-4b13-4df6-ad5d-fc043574a758 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:16.215158 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-82e1c24e-35bc-4093-b5d5-635ae0fb5388 req-023c7965-4b13-4df6-ad5d-fc043574a758 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:16.245828 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-82e1c24e-35bc-4093-b5d5-635ae0fb5388 req-023c7965-4b13-4df6-ad5d-fc043574a758 service nova] Creating event network-vif-plugged:d543cda5-e012-413e-a613-191a01247465 for instance f7ec4c20-aa67-4eef-b593-0387c00a3684 on hv-cinder-82301 Jan 19 13:08:16.259065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-82e1c24e-35bc-4093-b5d5-635ae0fb5388 req-023c7965-4b13-4df6-ad5d-fc043574a758 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071344 Jan 19 13:08:16.259862 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 336/676] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:08:16.262599 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b55d4076-fdb3-47a2-b482-981856a96e54 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:16.263586 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b55d4076-fdb3-47a2-b482-981856a96e54 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:16.293508 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b55d4076-fdb3-47a2-b482-981856a96e54 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:16.293980 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b55d4076-fdb3-47a2-b482-981856a96e54 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:16.294788 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b55d4076-fdb3-47a2-b482-981856a96e54 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:16.295226 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b55d4076-fdb3-47a2-b482-981856a96e54 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:16.458813 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b55d4076-fdb3-47a2-b482-981856a96e54 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:16.466534 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b55d4076-fdb3-47a2-b482-981856a96e54 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1260 microversion: 2.1 time: 0.215288 Jan 19 13:08:16.467157 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 341/677] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:16 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:16.556312 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-cc7638d4-da83-4dc9-8b1c-7e78fa94707b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:16.557978 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-cc7638d4-da83-4dc9-8b1c-7e78fa94707b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:16.564229 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cc7638d4-da83-4dc9-8b1c-7e78fa94707b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:16.564906 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cc7638d4-da83-4dc9-8b1c-7e78fa94707b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:16.566029 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cc7638d4-da83-4dc9-8b1c-7e78fa94707b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:16.566636 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cc7638d4-da83-4dc9-8b1c-7e78fa94707b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:16.728318 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b5ff873c-6b74-49aa-8cc0-bb3c3a2a3851 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:16.728985 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b5ff873c-6b74-49aa-8cc0-bb3c3a2a3851 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:16.736774 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b5ff873c-6b74-49aa-8cc0-bb3c3a2a3851 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:16.737579 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b5ff873c-6b74-49aa-8cc0-bb3c3a2a3851 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:16.738561 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b5ff873c-6b74-49aa-8cc0-bb3c3a2a3851 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:16.738992 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b5ff873c-6b74-49aa-8cc0-bb3c3a2a3851 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:16.893241 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b5ff873c-6b74-49aa-8cc0-bb3c3a2a3851 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:16.901713 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b5ff873c-6b74-49aa-8cc0-bb3c3a2a3851 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 0.177044 Jan 19 13:08:16.911819 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 342/678] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:16 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:16.912614 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-cc7638d4-da83-4dc9-8b1c-7e78fa94707b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 38166 microversion: 2.20 time: 0.358251 Jan 19 13:08:16.913495 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 337/679] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:16 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 38166 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:08:16.917172 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8a232122-18cc-43d9-be4c-74508bcd527e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:16.918107 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8a232122-18cc-43d9-be4c-74508bcd527e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:16.925681 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8a232122-18cc-43d9-be4c-74508bcd527e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:16.926112 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8a232122-18cc-43d9-be4c-74508bcd527e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:16.927099 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8a232122-18cc-43d9-be4c-74508bcd527e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:16.927536 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8a232122-18cc-43d9-be4c-74508bcd527e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:17.012093 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8a232122-18cc-43d9-be4c-74508bcd527e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 36243 microversion: 2.1 time: 0.097948 Jan 19 13:08:17.013358 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 343/680] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:16 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 36243 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:08:17.486204 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b914ffc7-0938-495f-b763-d4f1c8f3809b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:17.488196 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b914ffc7-0938-495f-b763-d4f1c8f3809b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:17.498741 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b914ffc7-0938-495f-b763-d4f1c8f3809b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:17.499194 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b914ffc7-0938-495f-b763-d4f1c8f3809b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:17.500005 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b914ffc7-0938-495f-b763-d4f1c8f3809b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:17.500441 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b914ffc7-0938-495f-b763-d4f1c8f3809b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:17.656320 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b914ffc7-0938-495f-b763-d4f1c8f3809b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:17.665904 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b914ffc7-0938-495f-b763-d4f1c8f3809b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1260 microversion: 2.1 time: 0.185736 Jan 19 13:08:17.666992 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 338/681] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:17 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:17.923080 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8ec01383-5ac9-4692-9790-48c25a4abc27 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:17.924268 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8ec01383-5ac9-4692-9790-48c25a4abc27 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:17.928565 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-020895e8-7280-47d9-be46-787713766040 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:17.930246 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-020895e8-7280-47d9-be46-787713766040 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:17.935431 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8ec01383-5ac9-4692-9790-48c25a4abc27 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:17.936249 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8ec01383-5ac9-4692-9790-48c25a4abc27 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:17.937909 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8ec01383-5ac9-4692-9790-48c25a4abc27 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:17.938583 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8ec01383-5ac9-4692-9790-48c25a4abc27 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:17.939971 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-020895e8-7280-47d9-be46-787713766040 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:17.942381 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-020895e8-7280-47d9-be46-787713766040 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:17.943365 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-020895e8-7280-47d9-be46-787713766040 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:17.943953 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-020895e8-7280-47d9-be46-787713766040 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:18.061467 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-020895e8-7280-47d9-be46-787713766040 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 38166 microversion: 2.20 time: 0.139247 Jan 19 13:08:18.064253 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 339/682] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:17 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 38166 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:08:18.075175 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-1e0aa391-056e-41e7-8728-017f4f9279f4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:18.076580 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-1e0aa391-056e-41e7-8728-017f4f9279f4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:18.085662 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1e0aa391-056e-41e7-8728-017f4f9279f4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:18.086540 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1e0aa391-056e-41e7-8728-017f4f9279f4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:18.088212 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1e0aa391-056e-41e7-8728-017f4f9279f4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:18.089153 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1e0aa391-056e-41e7-8728-017f4f9279f4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:18.161110 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-8ec01383-5ac9-4692-9790-48c25a4abc27 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:18.172110 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8ec01383-5ac9-4692-9790-48c25a4abc27 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 0.256202 Jan 19 13:08:18.173274 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 344/683] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:17 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:18.204378 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-1e0aa391-056e-41e7-8728-017f4f9279f4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 37150 microversion: 2.1 time: 0.136259 Jan 19 13:08:18.205423 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 340/684] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:18 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 37150 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:08:18.683128 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-965fd79f-43a2-4b92-8f7f-afcee1e40237 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:18.683757 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-965fd79f-43a2-4b92-8f7f-afcee1e40237 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:18.700153 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-965fd79f-43a2-4b92-8f7f-afcee1e40237 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:18.700831 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-965fd79f-43a2-4b92-8f7f-afcee1e40237 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:18.701814 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-965fd79f-43a2-4b92-8f7f-afcee1e40237 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:18.702410 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-965fd79f-43a2-4b92-8f7f-afcee1e40237 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:19.076018 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0ef9069c-b025-446e-8343-1617fa96e9f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:19.077233 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0ef9069c-b025-446e-8343-1617fa96e9f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:19.088678 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ef9069c-b025-446e-8343-1617fa96e9f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:19.096893 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ef9069c-b025-446e-8343-1617fa96e9f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:19.098216 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ef9069c-b025-446e-8343-1617fa96e9f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:19.098828 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ef9069c-b025-446e-8343-1617fa96e9f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:19.168410 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-965fd79f-43a2-4b92-8f7f-afcee1e40237 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:19.177217 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-965fd79f-43a2-4b92-8f7f-afcee1e40237 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1444 microversion: 2.1 time: 0.498036 Jan 19 13:08:19.178389 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 345/685] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:18 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1444 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:19.197729 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c6d92633-49cb-46a1-832e-76605491312f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:19.198382 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c6d92633-49cb-46a1-832e-76605491312f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:19.206971 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c6d92633-49cb-46a1-832e-76605491312f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:19.208227 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0ef9069c-b025-446e-8343-1617fa96e9f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 38166 microversion: 2.20 time: 0.136553 Jan 19 13:08:19.209515 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 341/686] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:19 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 38166 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:08:19.216173 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c6d92633-49cb-46a1-832e-76605491312f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:19.217422 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c5b0a738-7e5f-418f-a5ce-3db99520bbcf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:19.218519 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c5b0a738-7e5f-418f-a5ce-3db99520bbcf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:19.223801 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c6d92633-49cb-46a1-832e-76605491312f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:19.224547 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c6d92633-49cb-46a1-832e-76605491312f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:19.232530 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c5b0a738-7e5f-418f-a5ce-3db99520bbcf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:19.235879 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c5b0a738-7e5f-418f-a5ce-3db99520bbcf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:19.239579 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c5b0a738-7e5f-418f-a5ce-3db99520bbcf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:19.240329 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c5b0a738-7e5f-418f-a5ce-3db99520bbcf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:19.624753 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-c6d92633-49cb-46a1-832e-76605491312f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:19.636949 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c6d92633-49cb-46a1-832e-76605491312f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1444 microversion: 2.1 time: 0.445126 Jan 19 13:08:19.638282 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 346/687] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:19 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1444 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:19.649903 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c5b0a738-7e5f-418f-a5ce-3db99520bbcf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:19.672425 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c5b0a738-7e5f-418f-a5ce-3db99520bbcf tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 0.461168 Jan 19 13:08:19.673006 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 342/688] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:19 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:19.676389 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1bf15f1d-16e3-4c60-bdbb-882949686029 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:19.677574 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1bf15f1d-16e3-4c60-bdbb-882949686029 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:19.696693 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1bf15f1d-16e3-4c60-bdbb-882949686029 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:19.698279 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1bf15f1d-16e3-4c60-bdbb-882949686029 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:19.703625 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1bf15f1d-16e3-4c60-bdbb-882949686029 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:19.704346 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1bf15f1d-16e3-4c60-bdbb-882949686029 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:19.814549 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1bf15f1d-16e3-4c60-bdbb-882949686029 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 38165 microversion: 2.1 time: 0.174845 Jan 19 13:08:19.816860 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 347/689] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:19 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 38165 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:08:20.220361 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-555c463b-2314-4b2a-8298-693619a476e2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:20.221299 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-555c463b-2314-4b2a-8298-693619a476e2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:20.228056 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-555c463b-2314-4b2a-8298-693619a476e2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:20.229189 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-555c463b-2314-4b2a-8298-693619a476e2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:20.229339 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-555c463b-2314-4b2a-8298-693619a476e2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:20.229739 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-555c463b-2314-4b2a-8298-693619a476e2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:20.343717 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-555c463b-2314-4b2a-8298-693619a476e2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 200 len: 38309 microversion: 2.20 time: 0.127320 Jan 19 13:08:20.344756 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 343/690] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:20 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 38309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:08:20.356757 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2ac19985-1f58-423e-b8be-70c24640ae49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:20.357984 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2ac19985-1f58-423e-b8be-70c24640ae49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:20.372089 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ac19985-1f58-423e-b8be-70c24640ae49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:20.372918 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ac19985-1f58-423e-b8be-70c24640ae49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:20.374174 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ac19985-1f58-423e-b8be-70c24640ae49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:20.374858 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ac19985-1f58-423e-b8be-70c24640ae49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:20.421177 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2ac19985-1f58-423e-b8be-70c24640ae49 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/ips" status: 200 len: 149 microversion: 2.20 time: 0.066375 Jan 19 13:08:20.428427 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 348/691] 10.222.0.48 () {60 vars in 1288 bytes} [Wed Jan 19 13:08:20 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/ips => generated 149 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:08:20.692399 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7695b71e-52fe-4664-bc87-931c92256d5e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:20.693115 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7695b71e-52fe-4664-bc87-931c92256d5e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:20.706869 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7695b71e-52fe-4664-bc87-931c92256d5e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:20.707323 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7695b71e-52fe-4664-bc87-931c92256d5e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:20.708147 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7695b71e-52fe-4664-bc87-931c92256d5e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:20.708689 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7695b71e-52fe-4664-bc87-931c92256d5e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:20.831324 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-74fa22b3-30b5-4496-9569-b823415eb27f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:20.833954 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-74fa22b3-30b5-4496-9569-b823415eb27f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:20.860960 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-74fa22b3-30b5-4496-9569-b823415eb27f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:20.864299 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-74fa22b3-30b5-4496-9569-b823415eb27f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:20.865777 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-74fa22b3-30b5-4496-9569-b823415eb27f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:20.867553 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-74fa22b3-30b5-4496-9569-b823415eb27f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:20.963648 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-74fa22b3-30b5-4496-9569-b823415eb27f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 38165 microversion: 2.1 time: 0.140399 Jan 19 13:08:20.965369 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 349/692] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:20 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 38165 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:08:21.262669 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7695b71e-52fe-4664-bc87-931c92256d5e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:21.279704 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7695b71e-52fe-4664-bc87-931c92256d5e tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 0.591181 Jan 19 13:08:21.280502 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 344/693] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:20 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:21.975712 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f0d8a5ca-1711-4cae-a76c-053a1f738934 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:21.978322 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f0d8a5ca-1711-4cae-a76c-053a1f738934 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:21.985085 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f0d8a5ca-1711-4cae-a76c-053a1f738934 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:21.985713 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f0d8a5ca-1711-4cae-a76c-053a1f738934 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:21.986669 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f0d8a5ca-1711-4cae-a76c-053a1f738934 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:21.987397 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f0d8a5ca-1711-4cae-a76c-053a1f738934 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:22.085694 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f0d8a5ca-1711-4cae-a76c-053a1f738934 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 38165 microversion: 2.1 time: 0.114384 Jan 19 13:08:22.086659 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 350/694] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:21 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 38165 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:08:22.310149 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-775aee4f-622b-41fe-b22e-4c781072a877 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:22.319801 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-775aee4f-622b-41fe-b22e-4c781072a877 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:22.347445 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-775aee4f-622b-41fe-b22e-4c781072a877 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:22.355863 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-775aee4f-622b-41fe-b22e-4c781072a877 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:22.358084 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-775aee4f-622b-41fe-b22e-4c781072a877 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:22.362698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-775aee4f-622b-41fe-b22e-4c781072a877 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:22.675622 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-775aee4f-622b-41fe-b22e-4c781072a877 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d05bff640440a1a71fc35306e96858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a46b7542c5e47579c80a7d0fd01e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:22.687108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-775aee4f-622b-41fe-b22e-4c781072a877 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 200 len: 1521 microversion: 2.1 time: 0.393455 Jan 19 13:08:22.698258 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 345/695] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:22 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:22.759934 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-92100d34-a752-459a-bec8-c17bc23f1cbd req-246d3576-5978-4b54-8cd5-291836296c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ec4c20-aa67-4eef-b593-0387c00a3684", "tag": "d543cda5-e012-413e-a613-191a01247465"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:22.762565 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:08:22.762565 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:08:22.773833 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-92100d34-a752-459a-bec8-c17bc23f1cbd req-246d3576-5978-4b54-8cd5-291836296c25 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:22.774546 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-92100d34-a752-459a-bec8-c17bc23f1cbd req-246d3576-5978-4b54-8cd5-291836296c25 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:22.788503 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-92100d34-a752-459a-bec8-c17bc23f1cbd req-246d3576-5978-4b54-8cd5-291836296c25 service nova] Creating event network-changed:d543cda5-e012-413e-a613-191a01247465 for instance f7ec4c20-aa67-4eef-b593-0387c00a3684 on hv-cinder-82301 Jan 19 13:08:22.795074 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-92100d34-a752-459a-bec8-c17bc23f1cbd req-246d3576-5978-4b54-8cd5-291836296c25 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039332 Jan 19 13:08:22.795837 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 351/696] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:08:22.930952 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-034759ac-b6a6-4be4-9ad6-64d556dfd6c0 req-ee66aba7-3f47-4f62-b137-34a5e8f6dc50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b74c954-19e1-498d-a9b6-c0fb2663635a", "name": "network-vif-deleted", "tag": "f0c36288-465f-49ee-ad3b-75329de2fc61"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:22.932779 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:08:22.932779 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:08:22.945296 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-034759ac-b6a6-4be4-9ad6-64d556dfd6c0 req-ee66aba7-3f47-4f62-b137-34a5e8f6dc50 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:22.945741 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-034759ac-b6a6-4be4-9ad6-64d556dfd6c0 req-ee66aba7-3f47-4f62-b137-34a5e8f6dc50 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:22.975012 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-bc0f15e7-0270-4721-851f-7d5fc2e35a7e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:22.975632 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-bc0f15e7-0270-4721-851f-7d5fc2e35a7e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:22.991396 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-034759ac-b6a6-4be4-9ad6-64d556dfd6c0 req-ee66aba7-3f47-4f62-b137-34a5e8f6dc50 service nova] Creating event network-vif-deleted:f0c36288-465f-49ee-ad3b-75329de2fc61 for instance 9b74c954-19e1-498d-a9b6-c0fb2663635a on hv-cinder-82301 Jan 19 13:08:22.994157 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bc0f15e7-0270-4721-851f-7d5fc2e35a7e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:22.994898 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bc0f15e7-0270-4721-851f-7d5fc2e35a7e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:22.995795 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bc0f15e7-0270-4721-851f-7d5fc2e35a7e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:22.996365 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bc0f15e7-0270-4721-851f-7d5fc2e35a7e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:23.003593 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-034759ac-b6a6-4be4-9ad6-64d556dfd6c0 req-ee66aba7-3f47-4f62-b137-34a5e8f6dc50 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075957 Jan 19 13:08:23.007363 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 346/697] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:08:23.048114 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.objects.instance [None req-bc0f15e7-0270-4721-851f-7d5fc2e35a7e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lazy-loading 'flavor' on Instance uuid 0a2fc94f-e55f-4947-9824-ffc6edf35e0c {{(pid=116361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:08:23.099482 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e569d689-0151-4852-b209-b2cca6b69ce8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:23.101733 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e569d689-0151-4852-b209-b2cca6b69ce8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:23.109917 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e569d689-0151-4852-b209-b2cca6b69ce8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:23.111646 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e569d689-0151-4852-b209-b2cca6b69ce8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:23.115087 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e569d689-0151-4852-b209-b2cca6b69ce8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:23.117718 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e569d689-0151-4852-b209-b2cca6b69ce8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:23.234068 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e569d689-0151-4852-b209-b2cca6b69ce8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 200 len: 38292 microversion: 2.1 time: 0.139616 Jan 19 13:08:23.235188 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 347/698] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:23 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 38292 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:08:23.245340 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-05d6f873-b64b-4b7f-889c-623ba8b7d6ab tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:23.245928 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-05d6f873-b64b-4b7f-889c-623ba8b7d6ab tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:23.254394 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-05d6f873-b64b-4b7f-889c-623ba8b7d6ab tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:23.255095 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-05d6f873-b64b-4b7f-889c-623ba8b7d6ab tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:23.256136 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-05d6f873-b64b-4b7f-889c-623ba8b7d6ab tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:23.256812 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-05d6f873-b64b-4b7f-889c-623ba8b7d6ab tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:23.288336 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-05d6f873-b64b-4b7f-889c-623ba8b7d6ab tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/ips" status: 200 len: 146 microversion: 2.1 time: 0.046944 Jan 19 13:08:23.290361 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 348/699] 10.222.0.48 () {58 vars in 1247 bytes} [Wed Jan 19 13:08:23 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/ips => generated 146 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:08:23.570945 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-bc0f15e7-0270-4721-851f-7d5fc2e35a7e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 202 len: 0 microversion: 2.20 time: 0.600421 Jan 19 13:08:23.580072 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 352/700] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:08:22 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:08:23.587635 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-03ae7e61-25fd-46a8-aacf-54f94dcc1fbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:23.588826 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-03ae7e61-25fd-46a8-aacf-54f94dcc1fbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:23.611313 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-03ae7e61-25fd-46a8-aacf-54f94dcc1fbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:23.616713 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-03ae7e61-25fd-46a8-aacf-54f94dcc1fbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:23.617798 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-03ae7e61-25fd-46a8-aacf-54f94dcc1fbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:23.619425 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-03ae7e61-25fd-46a8-aacf-54f94dcc1fbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:23.707077 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8eba3dd6-2272-4bfc-88d7-02f6537f1d10 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:23.707786 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8eba3dd6-2272-4bfc-88d7-02f6537f1d10 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] [instance: 9b74c954-19e1-498d-a9b6-c0fb2663635a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:23.724825 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8eba3dd6-2272-4bfc-88d7-02f6537f1d10 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:23.725366 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8eba3dd6-2272-4bfc-88d7-02f6537f1d10 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:23.726217 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8eba3dd6-2272-4bfc-88d7-02f6537f1d10 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:23.726664 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8eba3dd6-2272-4bfc-88d7-02f6537f1d10 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:23.779832 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-8eba3dd6-2272-4bfc-88d7-02f6537f1d10 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] HTTP exception thrown: Instance 9b74c954-19e1-498d-a9b6-c0fb2663635a could not be found. Jan 19 13:08:23.780495 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8eba3dd6-2272-4bfc-88d7-02f6537f1d10 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] Returning 404 to user: Instance 9b74c954-19e1-498d-a9b6-c0fb2663635a could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:08:23.781339 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8eba3dd6-2272-4bfc-88d7-02f6537f1d10 tempest-ServerRescueNegativeTestJSON-1691421680 tempest-ServerRescueNegativeTestJSON-1691421680-project] 10.222.0.48 "GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a" status: 404 len: 111 microversion: 2.1 time: 0.078317 Jan 19 13:08:23.781924 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 353/701] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:23 2022] GET /compute/v2.1/servers/9b74c954-19e1-498d-a9b6-c0fb2663635a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:08:24.065077 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-03ae7e61-25fd-46a8-aacf-54f94dcc1fbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:24.089685 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-03ae7e61-25fd-46a8-aacf-54f94dcc1fbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:24.092393 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-03ae7e61-25fd-46a8-aacf-54f94dcc1fbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:24.093579 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-03ae7e61-25fd-46a8-aacf-54f94dcc1fbf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1721 microversion: 2.20 time: 0.510903 Jan 19 13:08:24.098800 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 349/702] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:23 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1721 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:25.117015 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8a402a31-b7c7-4528-9b58-f15369bce148 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:25.118359 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8a402a31-b7c7-4528-9b58-f15369bce148 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:25.125941 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8a402a31-b7c7-4528-9b58-f15369bce148 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:25.126749 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8a402a31-b7c7-4528-9b58-f15369bce148 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:25.127853 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8a402a31-b7c7-4528-9b58-f15369bce148 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:25.128545 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8a402a31-b7c7-4528-9b58-f15369bce148 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:25.375376 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-8a402a31-b7c7-4528-9b58-f15369bce148 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:25.384048 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-8a402a31-b7c7-4528-9b58-f15369bce148 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:25.385570 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-8a402a31-b7c7-4528-9b58-f15369bce148 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:25.386999 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8a402a31-b7c7-4528-9b58-f15369bce148 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1721 microversion: 2.20 time: 0.275086 Jan 19 13:08:25.398919 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 354/703] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:25 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:25.657242 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9d303e52-6ce8-47d6-a506-4cbdcde24efc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41d7e0ce-00ad-4048-92cc-1269f4205b92"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:25.659732 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9d303e52-6ce8-47d6-a506-4cbdcde24efc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:25.673477 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9d303e52-6ce8-47d6-a506-4cbdcde24efc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:25.674571 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9d303e52-6ce8-47d6-a506-4cbdcde24efc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:25.677733 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9d303e52-6ce8-47d6-a506-4cbdcde24efc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:25.679697 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9d303e52-6ce8-47d6-a506-4cbdcde24efc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:26.043593 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9d303e52-6ce8-47d6-a506-4cbdcde24efc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390046 Jan 19 13:08:26.044231 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 350/704] 10.222.0.48 () {60 vars in 1322 bytes} [Wed Jan 19 13:08:25 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:08:26.405210 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2826e96f-692c-45a4-bc92-cb1d8e23df9b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:26.410570 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2826e96f-692c-45a4-bc92-cb1d8e23df9b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:26.420942 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2826e96f-692c-45a4-bc92-cb1d8e23df9b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:26.423585 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2826e96f-692c-45a4-bc92-cb1d8e23df9b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:26.424937 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2826e96f-692c-45a4-bc92-cb1d8e23df9b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:26.426150 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2826e96f-692c-45a4-bc92-cb1d8e23df9b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:26.735610 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2826e96f-692c-45a4-bc92-cb1d8e23df9b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:26.745984 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2826e96f-692c-45a4-bc92-cb1d8e23df9b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:26.750838 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2826e96f-692c-45a4-bc92-cb1d8e23df9b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:26.752499 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2826e96f-692c-45a4-bc92-cb1d8e23df9b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1721 microversion: 2.20 time: 0.351051 Jan 19 13:08:26.754439 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 355/705] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:26 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1721 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:27.772985 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-662930ca-f74d-4519-85e7-5db48ebaea2e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:27.775054 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-662930ca-f74d-4519-85e7-5db48ebaea2e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:27.786973 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-662930ca-f74d-4519-85e7-5db48ebaea2e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:27.787831 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-662930ca-f74d-4519-85e7-5db48ebaea2e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:27.788922 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-662930ca-f74d-4519-85e7-5db48ebaea2e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:27.789709 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-662930ca-f74d-4519-85e7-5db48ebaea2e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:27.974709 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-662930ca-f74d-4519-85e7-5db48ebaea2e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:27.983413 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-662930ca-f74d-4519-85e7-5db48ebaea2e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:27.985205 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-662930ca-f74d-4519-85e7-5db48ebaea2e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:27.986687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-662930ca-f74d-4519-85e7-5db48ebaea2e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1721 microversion: 2.20 time: 0.218504 Jan 19 13:08:27.989683 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 351/706] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:27 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:29.009350 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-65e98723-53b5-4694-a35a-f42b0bedf05b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:29.009912 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-65e98723-53b5-4694-a35a-f42b0bedf05b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:29.016998 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-65e98723-53b5-4694-a35a-f42b0bedf05b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:29.017819 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-65e98723-53b5-4694-a35a-f42b0bedf05b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:29.019628 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-65e98723-53b5-4694-a35a-f42b0bedf05b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:29.020279 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-65e98723-53b5-4694-a35a-f42b0bedf05b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:29.208605 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-65e98723-53b5-4694-a35a-f42b0bedf05b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:29.220455 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-65e98723-53b5-4694-a35a-f42b0bedf05b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:29.223112 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-65e98723-53b5-4694-a35a-f42b0bedf05b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:29.224789 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-65e98723-53b5-4694-a35a-f42b0bedf05b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1721 microversion: 2.20 time: 0.219185 Jan 19 13:08:29.225637 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 356/707] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:29 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:30.243520 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-83d7edd6-23d0-4083-b7bb-b55616da7a9c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:30.244230 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-83d7edd6-23d0-4083-b7bb-b55616da7a9c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:30.250936 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-83d7edd6-23d0-4083-b7bb-b55616da7a9c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:30.251401 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-83d7edd6-23d0-4083-b7bb-b55616da7a9c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:30.252208 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-83d7edd6-23d0-4083-b7bb-b55616da7a9c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:30.252700 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-83d7edd6-23d0-4083-b7bb-b55616da7a9c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:30.441049 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-83d7edd6-23d0-4083-b7bb-b55616da7a9c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:30.449764 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-83d7edd6-23d0-4083-b7bb-b55616da7a9c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:30.456528 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-83d7edd6-23d0-4083-b7bb-b55616da7a9c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:30.457963 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-83d7edd6-23d0-4083-b7bb-b55616da7a9c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1721 microversion: 2.20 time: 0.218953 Jan 19 13:08:30.460271 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 352/708] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:30 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:31.496979 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-fa7e03c9-72f3-4c40-a792-c027736614c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:31.498230 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-fa7e03c9-72f3-4c40-a792-c027736614c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:31.512074 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fa7e03c9-72f3-4c40-a792-c027736614c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:31.515389 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fa7e03c9-72f3-4c40-a792-c027736614c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:31.518608 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fa7e03c9-72f3-4c40-a792-c027736614c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:31.519352 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fa7e03c9-72f3-4c40-a792-c027736614c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:31.699521 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-fa7e03c9-72f3-4c40-a792-c027736614c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:31.709970 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-fa7e03c9-72f3-4c40-a792-c027736614c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:31.712205 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-fa7e03c9-72f3-4c40-a792-c027736614c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:31.713991 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-fa7e03c9-72f3-4c40-a792-c027736614c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1721 microversion: 2.20 time: 0.228045 Jan 19 13:08:31.715173 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 357/709] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:31 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:32.732435 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-dbbd0217-ae57-4760-adf9-d4e5c7ef8223 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:32.733722 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-dbbd0217-ae57-4760-adf9-d4e5c7ef8223 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:32.741104 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dbbd0217-ae57-4760-adf9-d4e5c7ef8223 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:32.742031 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dbbd0217-ae57-4760-adf9-d4e5c7ef8223 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:32.743330 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dbbd0217-ae57-4760-adf9-d4e5c7ef8223 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:32.743941 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dbbd0217-ae57-4760-adf9-d4e5c7ef8223 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:32.914664 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-dbbd0217-ae57-4760-adf9-d4e5c7ef8223 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:32.923454 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-dbbd0217-ae57-4760-adf9-d4e5c7ef8223 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:32.925367 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-dbbd0217-ae57-4760-adf9-d4e5c7ef8223 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:32.927005 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-dbbd0217-ae57-4760-adf9-d4e5c7ef8223 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1721 microversion: 2.20 time: 0.198311 Jan 19 13:08:32.940718 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 353/710] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:32 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:33.738400 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1fb28416-b3f4-4e66-8a8a-7ebc09dc83db tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:33.746189 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1fb28416-b3f4-4e66-8a8a-7ebc09dc83db tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:33.746938 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1fb28416-b3f4-4e66-8a8a-7ebc09dc83db tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:33.815195 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1fb28416-b3f4-4e66-8a8a-7ebc09dc83db tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Going to try to stop instance {{(pid=116361) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 19 13:08:33.897019 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1fb28416-b3f4-4e66-8a8a-7ebc09dc83db tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 202 len: 0 microversion: 2.1 time: 0.162837 Jan 19 13:08:33.897674 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 358/711] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:33 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:08:33.914743 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4188acf3-8db4-4eee-9d5e-6f6e6c994128 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:33.918119 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4188acf3-8db4-4eee-9d5e-6f6e6c994128 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:33.930700 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4188acf3-8db4-4eee-9d5e-6f6e6c994128 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:33.931467 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4188acf3-8db4-4eee-9d5e-6f6e6c994128 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:33.932721 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4188acf3-8db4-4eee-9d5e-6f6e6c994128 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:33.933367 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4188acf3-8db4-4eee-9d5e-6f6e6c994128 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:33.946329 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2372cb14-6d5d-4040-9642-9c190d4a175a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:33.947660 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2372cb14-6d5d-4040-9642-9c190d4a175a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:33.956521 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2372cb14-6d5d-4040-9642-9c190d4a175a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:33.957330 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2372cb14-6d5d-4040-9642-9c190d4a175a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:33.961894 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2372cb14-6d5d-4040-9642-9c190d4a175a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:33.962420 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2372cb14-6d5d-4040-9642-9c190d4a175a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:34.347770 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4188acf3-8db4-4eee-9d5e-6f6e6c994128 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:34.355902 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2372cb14-6d5d-4040-9642-9c190d4a175a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:34.359823 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4188acf3-8db4-4eee-9d5e-6f6e6c994128 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.456697 Jan 19 13:08:34.360530 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 354/712] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:33 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:34.375456 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2372cb14-6d5d-4040-9642-9c190d4a175a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:34.377097 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2372cb14-6d5d-4040-9642-9c190d4a175a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:34.379089 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2372cb14-6d5d-4040-9642-9c190d4a175a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1721 microversion: 2.20 time: 0.437113 Jan 19 13:08:34.380305 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 359/713] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:33 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1721 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:35.166808 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-649c3a49-a320-4ddd-ab6e-b4a9021d6764 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Action: 'create', calling method: .version_select at 0x7f07e4440040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1906444010"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:35.181415 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-649c3a49-a320-4ddd-ab6e-b4a9021d6764 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Getting quotas for project 2305bfa32e0e4c0c8e01122c1d1e783c. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:08:35.185148 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-649c3a49-a320-4ddd-ab6e-b4a9021d6764 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Getting quotas for user a72fd413268b4cf3bac09ca9f1053713 and project 2305bfa32e0e4c0c8e01122c1d1e783c. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:08:35.274090 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-649c3a49-a320-4ddd-ab6e-b4a9021d6764 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Getting quotas for project 2305bfa32e0e4c0c8e01122c1d1e783c. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:08:35.277702 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-649c3a49-a320-4ddd-ab6e-b4a9021d6764 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Getting quotas for user a72fd413268b4cf3bac09ca9f1053713 and project 2305bfa32e0e4c0c8e01122c1d1e783c. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:08:35.291374 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-649c3a49-a320-4ddd-ab6e-b4a9021d6764 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.128165 Jan 19 13:08:35.295378 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 355/714] 10.222.0.48 () {60 vars in 1157 bytes} [Wed Jan 19 13:08:35 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:35.376980 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-93f00d78-19e0-44a3-b024-5f3ef2ed1ca2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:35.377883 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-93f00d78-19e0-44a3-b024-5f3ef2ed1ca2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:35.385050 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-93f00d78-19e0-44a3-b024-5f3ef2ed1ca2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:35.385448 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-93f00d78-19e0-44a3-b024-5f3ef2ed1ca2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:35.386470 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-93f00d78-19e0-44a3-b024-5f3ef2ed1ca2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:35.386904 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-93f00d78-19e0-44a3-b024-5f3ef2ed1ca2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:35.401112 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-608367039", "imageRef": "2520cfb9-b0d8-451e-a531-7b2cfb2fb911", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1906444010", "networks": [{"uuid": "cfceddf0-1e84-4822-b694-e9a10b6cd158"}]}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:35.454309 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.network.neutron [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] validate_networks() for [('cfceddf0-1e84-4822-b694-e9a10b6cd158', None, None, None, None, None)] {{(pid=116360) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:08:35.590270 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-93f00d78-19e0-44a3-b024-5f3ef2ed1ca2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:35.600856 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-93f00d78-19e0-44a3-b024-5f3ef2ed1ca2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.227336 Jan 19 13:08:35.601614 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 360/715] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:35 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:35.611278 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6a6d5cd4-a7cd-478b-9f2c-f25edef1f553 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:35.611278 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6a6d5cd4-a7cd-478b-9f2c-f25edef1f553 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:35.612720 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6a6d5cd4-a7cd-478b-9f2c-f25edef1f553 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:35.613241 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6a6d5cd4-a7cd-478b-9f2c-f25edef1f553 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:35.614092 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6a6d5cd4-a7cd-478b-9f2c-f25edef1f553 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:35.614592 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6a6d5cd4-a7cd-478b-9f2c-f25edef1f553 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:35.831323 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6a6d5cd4-a7cd-478b-9f2c-f25edef1f553 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:35.839761 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6a6d5cd4-a7cd-478b-9f2c-f25edef1f553 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:35.841311 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6a6d5cd4-a7cd-478b-9f2c-f25edef1f553 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:35.842468 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6a6d5cd4-a7cd-478b-9f2c-f25edef1f553 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1742 microversion: 2.20 time: 0.239871 Jan 19 13:08:35.843018 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 361/716] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:35 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1742 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:35.946112 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Flavor limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:08:35.946841 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Image limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:08:35.947481 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Flavor pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:08:35.948222 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Image pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:08:35.948640 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:08:35.960440 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:35.961058 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:35.963674 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:35.964726 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:35.985401 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Getting quotas for project 2305bfa32e0e4c0c8e01122c1d1e783c. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:08:35.990513 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Getting quotas for user a72fd413268b4cf3bac09ca9f1053713 and project 2305bfa32e0e4c0c8e01122c1d1e783c. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:08:36.001600 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Going to run 1 instances... {{(pid=116360) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:08:36.003898 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2520cfb9-b0d8-451e-a531-7b2cfb2fb911',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:08:36.050331 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9cb138e9-7380-43ac-ba45-a1d0dcc27fc5 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656491 Jan 19 13:08:36.051293 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 356/717] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:08:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:08:36.062665 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-74c6330b-88d6-4548-a985-92ce83480a49 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:36.063996 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-74c6330b-88d6-4548-a985-92ce83480a49 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:36.136540 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-74c6330b-88d6-4548-a985-92ce83480a49 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:36.144827 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-74c6330b-88d6-4548-a985-92ce83480a49 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1258 microversion: 2.1 time: 0.087362 Jan 19 13:08:36.156368 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 362/718] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:36 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1258 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:36.618963 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2b411060-1558-4d5b-9cf6-a5b6bebb8626 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:36.619679 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2b411060-1558-4d5b-9cf6-a5b6bebb8626 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:36.626838 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2b411060-1558-4d5b-9cf6-a5b6bebb8626 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:36.627787 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2b411060-1558-4d5b-9cf6-a5b6bebb8626 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:36.628675 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2b411060-1558-4d5b-9cf6-a5b6bebb8626 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:36.629180 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2b411060-1558-4d5b-9cf6-a5b6bebb8626 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:36.771181 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2b411060-1558-4d5b-9cf6-a5b6bebb8626 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:36.778896 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2b411060-1558-4d5b-9cf6-a5b6bebb8626 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.163984 Jan 19 13:08:36.779455 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 357/719] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:36 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:36.861248 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-33e9acf5-290c-48ce-a58c-02635c24d74e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:36.862119 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-33e9acf5-290c-48ce-a58c-02635c24d74e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:36.868624 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33e9acf5-290c-48ce-a58c-02635c24d74e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:36.869088 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33e9acf5-290c-48ce-a58c-02635c24d74e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:36.869870 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33e9acf5-290c-48ce-a58c-02635c24d74e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:36.870458 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33e9acf5-290c-48ce-a58c-02635c24d74e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:37.007557 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-33e9acf5-290c-48ce-a58c-02635c24d74e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:37.016195 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-33e9acf5-290c-48ce-a58c-02635c24d74e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:37.018601 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-33e9acf5-290c-48ce-a58c-02635c24d74e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:37.019787 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-33e9acf5-290c-48ce-a58c-02635c24d74e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1742 microversion: 2.20 time: 0.162462 Jan 19 13:08:37.020705 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 363/720] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:36 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:08:37.162601 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-da557bae-1933-4351-b547-00e98b5d38bf tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:37.163215 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-da557bae-1933-4351-b547-00e98b5d38bf tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:37.169485 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da557bae-1933-4351-b547-00e98b5d38bf tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:37.169485 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da557bae-1933-4351-b547-00e98b5d38bf tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:37.170163 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da557bae-1933-4351-b547-00e98b5d38bf tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:37.170595 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da557bae-1933-4351-b547-00e98b5d38bf tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:37.246718 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-da557bae-1933-4351-b547-00e98b5d38bf tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:37.257596 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-da557bae-1933-4351-b547-00e98b5d38bf tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1328 microversion: 2.1 time: 0.098716 Jan 19 13:08:37.258166 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 358/721] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:37 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:37.800007 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-97e2602d-1957-43d8-944d-386cbcdbe88c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:37.801645 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-97e2602d-1957-43d8-944d-386cbcdbe88c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:37.813486 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-97e2602d-1957-43d8-944d-386cbcdbe88c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:37.819046 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-97e2602d-1957-43d8-944d-386cbcdbe88c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:37.820125 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-97e2602d-1957-43d8-944d-386cbcdbe88c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:37.822468 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-97e2602d-1957-43d8-944d-386cbcdbe88c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:38.037571 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-584261be-11bb-4e54-9560-3b7c6b552d61 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:38.039236 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-584261be-11bb-4e54-9560-3b7c6b552d61 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:38.055508 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-584261be-11bb-4e54-9560-3b7c6b552d61 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:38.056212 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-584261be-11bb-4e54-9560-3b7c6b552d61 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:38.058794 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-584261be-11bb-4e54-9560-3b7c6b552d61 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:38.061615 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-584261be-11bb-4e54-9560-3b7c6b552d61 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:38.419787 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-97e2602d-1957-43d8-944d-386cbcdbe88c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:38.439843 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-97e2602d-1957-43d8-944d-386cbcdbe88c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.645847 Jan 19 13:08:38.446489 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 364/722] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:37 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:38.469080 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4a1a7252-87d6-48b7-a0e1-ea6f7173fce8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:38.469729 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4a1a7252-87d6-48b7-a0e1-ea6f7173fce8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:38.496141 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4a1a7252-87d6-48b7-a0e1-ea6f7173fce8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:38.496761 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4a1a7252-87d6-48b7-a0e1-ea6f7173fce8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:38.504005 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4a1a7252-87d6-48b7-a0e1-ea6f7173fce8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:38.504886 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4a1a7252-87d6-48b7-a0e1-ea6f7173fce8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:38.547121 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-584261be-11bb-4e54-9560-3b7c6b552d61 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:38.558616 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-584261be-11bb-4e54-9560-3b7c6b552d61 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:38.564201 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-584261be-11bb-4e54-9560-3b7c6b552d61 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:38.566337 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-584261be-11bb-4e54-9560-3b7c6b552d61 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1742 microversion: 2.20 time: 0.532503 Jan 19 13:08:38.567267 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 359/723] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:38 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1742 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:38.583012 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-a1c145ff-e401-4630-a208-371356618ea1 req-385ab099-f11a-4932-bb2e-5055cab32fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2fc94f-e55f-4947-9824-ffc6edf35e0c", "name": "network-vif-plugged", "status": "completed", "tag": "7e0a83a8-36d8-4d5c-baf5-d9396dafdb38"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:38.590316 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:08:38.590316 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:08:38.598620 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-a1c145ff-e401-4630-a208-371356618ea1 req-385ab099-f11a-4932-bb2e-5055cab32fa8 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:38.598816 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-a1c145ff-e401-4630-a208-371356618ea1 req-385ab099-f11a-4932-bb2e-5055cab32fa8 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:38.610296 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-a1c145ff-e401-4630-a208-371356618ea1 req-385ab099-f11a-4932-bb2e-5055cab32fa8 service nova] Creating event network-vif-plugged:7e0a83a8-36d8-4d5c-baf5-d9396dafdb38 for instance 0a2fc94f-e55f-4947-9824-ffc6edf35e0c on hv-cinder-82301 Jan 19 13:08:38.615486 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-a1c145ff-e401-4630-a208-371356618ea1 req-385ab099-f11a-4932-bb2e-5055cab32fa8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043252 Jan 19 13:08:38.619551 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 360/724] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:08:38.799690 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4a1a7252-87d6-48b7-a0e1-ea6f7173fce8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:38.810319 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4a1a7252-87d6-48b7-a0e1-ea6f7173fce8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.360354 Jan 19 13:08:38.811492 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 365/725] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:38 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:39.241037 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-40a677c9-dc58-4da8-899e-c87ce65d0d84 req-611620fe-d4f3-4845-b85f-da2b932f12d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d4306e3-3a88-4757-9de6-b3d2be139e7a", "tag": "03697968-160d-4c34-bd56-d5220e2b4d4c"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:39.243346 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:08:39.243346 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:08:39.268987 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-40a677c9-dc58-4da8-899e-c87ce65d0d84 req-611620fe-d4f3-4845-b85f-da2b932f12d6 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:39.271706 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-40a677c9-dc58-4da8-899e-c87ce65d0d84 req-611620fe-d4f3-4845-b85f-da2b932f12d6 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:39.294341 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-40a677c9-dc58-4da8-899e-c87ce65d0d84 req-611620fe-d4f3-4845-b85f-da2b932f12d6 service nova] Creating event network-changed:03697968-160d-4c34-bd56-d5220e2b4d4c for instance 3d4306e3-3a88-4757-9de6-b3d2be139e7a on hv-cinder-82301 Jan 19 13:08:39.304556 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-40a677c9-dc58-4da8-899e-c87ce65d0d84 req-611620fe-d4f3-4845-b85f-da2b932f12d6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068514 Jan 19 13:08:39.305645 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 361/726] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:08:39.464245 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c5bdd1f1-85a0-4b06-9744-4a8bf98bea6c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:39.465490 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c5bdd1f1-85a0-4b06-9744-4a8bf98bea6c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:39.474469 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5bdd1f1-85a0-4b06-9744-4a8bf98bea6c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:39.477250 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5bdd1f1-85a0-4b06-9744-4a8bf98bea6c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:39.478110 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5bdd1f1-85a0-4b06-9744-4a8bf98bea6c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:39.478556 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5bdd1f1-85a0-4b06-9744-4a8bf98bea6c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:39.590559 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f60aaf83-e381-4911-9cf1-0513c4504a94 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:39.591526 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f60aaf83-e381-4911-9cf1-0513c4504a94 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:39.600806 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f60aaf83-e381-4911-9cf1-0513c4504a94 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:39.601775 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f60aaf83-e381-4911-9cf1-0513c4504a94 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:39.603557 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f60aaf83-e381-4911-9cf1-0513c4504a94 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:39.604390 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f60aaf83-e381-4911-9cf1-0513c4504a94 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:39.655811 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-c5bdd1f1-85a0-4b06-9744-4a8bf98bea6c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:39.666888 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c5bdd1f1-85a0-4b06-9744-4a8bf98bea6c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.212822 Jan 19 13:08:39.667470 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 366/727] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:39 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:39.807109 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f60aaf83-e381-4911-9cf1-0513c4504a94 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:39.817080 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f60aaf83-e381-4911-9cf1-0513c4504a94 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:39.818600 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f60aaf83-e381-4911-9cf1-0513c4504a94 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:39.819929 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f60aaf83-e381-4911-9cf1-0513c4504a94 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1742 microversion: 2.20 time: 0.233260 Jan 19 13:08:39.820511 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 362/728] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:39 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1742 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:39.831173 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b12578c0-24e2-4f46-86ec-ea1342151496 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:39.831308 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b12578c0-24e2-4f46-86ec-ea1342151496 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:39.837966 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b12578c0-24e2-4f46-86ec-ea1342151496 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:39.838403 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b12578c0-24e2-4f46-86ec-ea1342151496 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:39.839307 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b12578c0-24e2-4f46-86ec-ea1342151496 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:39.839650 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b12578c0-24e2-4f46-86ec-ea1342151496 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:40.014794 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b12578c0-24e2-4f46-86ec-ea1342151496 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:40.023740 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b12578c0-24e2-4f46-86ec-ea1342151496 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.197930 Jan 19 13:08:40.024680 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 367/729] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:39 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:40.685218 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-902d6c60-0600-427f-863b-ef0ffe4b5669 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:40.686074 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-902d6c60-0600-427f-863b-ef0ffe4b5669 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:40.700243 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-902d6c60-0600-427f-863b-ef0ffe4b5669 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:40.700991 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-902d6c60-0600-427f-863b-ef0ffe4b5669 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:40.702030 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-902d6c60-0600-427f-863b-ef0ffe4b5669 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:40.702626 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-902d6c60-0600-427f-863b-ef0ffe4b5669 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:40.843529 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9d762aa2-5491-4cc8-8a93-6215fa5d480b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:40.848430 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9d762aa2-5491-4cc8-8a93-6215fa5d480b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:40.856771 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-902d6c60-0600-427f-863b-ef0ffe4b5669 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:40.868271 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9d762aa2-5491-4cc8-8a93-6215fa5d480b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:40.869296 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9d762aa2-5491-4cc8-8a93-6215fa5d480b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:40.870105 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9d762aa2-5491-4cc8-8a93-6215fa5d480b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:40.870539 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9d762aa2-5491-4cc8-8a93-6215fa5d480b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:40.871125 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-902d6c60-0600-427f-863b-ef0ffe4b5669 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.189842 Jan 19 13:08:40.879387 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 363/730] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:40 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:41.032203 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-9d762aa2-5491-4cc8-8a93-6215fa5d480b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:41.042097 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-9d762aa2-5491-4cc8-8a93-6215fa5d480b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:41.043234 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-99c88c36-a66d-453b-a531-9691302138bb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:41.043586 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-9d762aa2-5491-4cc8-8a93-6215fa5d480b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:41.044298 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-99c88c36-a66d-453b-a531-9691302138bb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:41.044830 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9d762aa2-5491-4cc8-8a93-6215fa5d480b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1742 microversion: 2.20 time: 0.209858 Jan 19 13:08:41.045369 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 368/731] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:40 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1742 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:08:41.054598 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-99c88c36-a66d-453b-a531-9691302138bb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:41.056079 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-99c88c36-a66d-453b-a531-9691302138bb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:41.057680 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-99c88c36-a66d-453b-a531-9691302138bb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:41.058427 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-99c88c36-a66d-453b-a531-9691302138bb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:41.202726 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-99c88c36-a66d-453b-a531-9691302138bb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:41.211466 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-99c88c36-a66d-453b-a531-9691302138bb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.174555 Jan 19 13:08:41.212062 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 364/732] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:41 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:41.897172 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1752ce93-42f6-4bb3-8ea6-25b6e56b44ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:41.897792 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1752ce93-42f6-4bb3-8ea6-25b6e56b44ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:41.904041 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1752ce93-42f6-4bb3-8ea6-25b6e56b44ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:41.904536 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1752ce93-42f6-4bb3-8ea6-25b6e56b44ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:41.905354 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1752ce93-42f6-4bb3-8ea6-25b6e56b44ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:41.905793 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1752ce93-42f6-4bb3-8ea6-25b6e56b44ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:42.068264 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-349b0d60-6ccc-4d51-9605-4439f678ee2b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:42.069488 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-349b0d60-6ccc-4d51-9605-4439f678ee2b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:42.077583 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-349b0d60-6ccc-4d51-9605-4439f678ee2b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:42.078212 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-349b0d60-6ccc-4d51-9605-4439f678ee2b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:42.079183 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-349b0d60-6ccc-4d51-9605-4439f678ee2b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:42.079923 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-349b0d60-6ccc-4d51-9605-4439f678ee2b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:42.224729 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-1752ce93-42f6-4bb3-8ea6-25b6e56b44ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:42.253402 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1752ce93-42f6-4bb3-8ea6-25b6e56b44ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.360353 Jan 19 13:08:42.268068 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 369/733] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:41 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:42.276357 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-38af9423-4bba-4dbc-ae84-3ce2d7fd976f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:42.277304 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-38af9423-4bba-4dbc-ae84-3ce2d7fd976f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:42.284554 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-38af9423-4bba-4dbc-ae84-3ce2d7fd976f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:42.285204 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-38af9423-4bba-4dbc-ae84-3ce2d7fd976f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:42.286160 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-38af9423-4bba-4dbc-ae84-3ce2d7fd976f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:42.286739 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-38af9423-4bba-4dbc-ae84-3ce2d7fd976f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:42.367054 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-349b0d60-6ccc-4d51-9605-4439f678ee2b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:42.375956 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-349b0d60-6ccc-4d51-9605-4439f678ee2b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:42.378088 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-349b0d60-6ccc-4d51-9605-4439f678ee2b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:42.380865 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-349b0d60-6ccc-4d51-9605-4439f678ee2b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1742 microversion: 2.20 time: 0.320843 Jan 19 13:08:42.392939 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 365/734] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:42 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1742 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:08:42.463516 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-38af9423-4bba-4dbc-ae84-3ce2d7fd976f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:42.472065 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-38af9423-4bba-4dbc-ae84-3ce2d7fd976f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.200452 Jan 19 13:08:42.472302 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 370/735] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:42 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:43.272820 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a8acc839-367e-4aa5-b2cf-0cc842455c8f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:43.274312 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a8acc839-367e-4aa5-b2cf-0cc842455c8f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:43.280810 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a8acc839-367e-4aa5-b2cf-0cc842455c8f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:43.281438 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a8acc839-367e-4aa5-b2cf-0cc842455c8f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:43.282475 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a8acc839-367e-4aa5-b2cf-0cc842455c8f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:43.283720 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a8acc839-367e-4aa5-b2cf-0cc842455c8f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:43.400252 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6f853043-bb75-4f65-8e52-5045ea20ac8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:43.401627 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6f853043-bb75-4f65-8e52-5045ea20ac8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:43.417602 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f853043-bb75-4f65-8e52-5045ea20ac8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:43.418312 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f853043-bb75-4f65-8e52-5045ea20ac8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:43.419355 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f853043-bb75-4f65-8e52-5045ea20ac8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:43.420076 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f853043-bb75-4f65-8e52-5045ea20ac8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:43.480749 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a8acc839-367e-4aa5-b2cf-0cc842455c8f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:43.490773 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a8acc839-367e-4aa5-b2cf-0cc842455c8f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.221582 Jan 19 13:08:43.491376 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 366/736] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:43 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:43.506380 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5f86f575-2a19-4aa4-aeb7-905671c80c77 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:43.507422 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5f86f575-2a19-4aa4-aeb7-905671c80c77 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:43.519779 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5f86f575-2a19-4aa4-aeb7-905671c80c77 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:43.521304 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5f86f575-2a19-4aa4-aeb7-905671c80c77 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:43.522399 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5f86f575-2a19-4aa4-aeb7-905671c80c77 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:43.523308 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5f86f575-2a19-4aa4-aeb7-905671c80c77 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:43.682003 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6f853043-bb75-4f65-8e52-5045ea20ac8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:43.706956 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6f853043-bb75-4f65-8e52-5045ea20ac8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:43.709214 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6f853043-bb75-4f65-8e52-5045ea20ac8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:43.714744 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6f853043-bb75-4f65-8e52-5045ea20ac8c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1742 microversion: 2.20 time: 0.318468 Jan 19 13:08:43.726533 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 371/737] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:43 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1742 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:08:43.755460 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5f86f575-2a19-4aa4-aeb7-905671c80c77 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:43.763688 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5f86f575-2a19-4aa4-aeb7-905671c80c77 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.261823 Jan 19 13:08:43.764620 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 367/738] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:43 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:44.508715 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3883255d-f08c-4b35-a86a-00419731273f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:44.509285 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3883255d-f08c-4b35-a86a-00419731273f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:44.516429 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3883255d-f08c-4b35-a86a-00419731273f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:44.516974 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3883255d-f08c-4b35-a86a-00419731273f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:44.517970 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3883255d-f08c-4b35-a86a-00419731273f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:44.518422 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3883255d-f08c-4b35-a86a-00419731273f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:44.657325 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3883255d-f08c-4b35-a86a-00419731273f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:44.666497 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3883255d-f08c-4b35-a86a-00419731273f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.161523 Jan 19 13:08:44.667526 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 372/739] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:44 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:44.733655 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6cd19fba-20a9-437f-a6a6-f7e90f5f14b4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:44.734258 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6cd19fba-20a9-437f-a6a6-f7e90f5f14b4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:44.741299 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6cd19fba-20a9-437f-a6a6-f7e90f5f14b4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:44.741870 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6cd19fba-20a9-437f-a6a6-f7e90f5f14b4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:44.742721 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6cd19fba-20a9-437f-a6a6-f7e90f5f14b4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:44.743167 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6cd19fba-20a9-437f-a6a6-f7e90f5f14b4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:44.781472 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7bd62326-594f-4ef1-8a05-7d2a3697a65f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:44.782005 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7bd62326-594f-4ef1-8a05-7d2a3697a65f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:44.791169 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7bd62326-594f-4ef1-8a05-7d2a3697a65f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:44.791625 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7bd62326-594f-4ef1-8a05-7d2a3697a65f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:44.792458 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7bd62326-594f-4ef1-8a05-7d2a3697a65f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:44.793157 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7bd62326-594f-4ef1-8a05-7d2a3697a65f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:44.950988 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6cd19fba-20a9-437f-a6a6-f7e90f5f14b4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:44.960780 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6cd19fba-20a9-437f-a6a6-f7e90f5f14b4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:44.962548 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6cd19fba-20a9-437f-a6a6-f7e90f5f14b4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:44.969847 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6cd19fba-20a9-437f-a6a6-f7e90f5f14b4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1742 microversion: 2.20 time: 0.239819 Jan 19 13:08:44.971124 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 368/740] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:44 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1742 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:44.995724 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-7bd62326-594f-4ef1-8a05-7d2a3697a65f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:45.003956 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7bd62326-594f-4ef1-8a05-7d2a3697a65f tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.226078 Jan 19 13:08:45.014066 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 373/741] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:44 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:45.684829 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-69c37d26-5d41-4bf4-8291-53e058fe7399 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:45.685589 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-69c37d26-5d41-4bf4-8291-53e058fe7399 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:45.691376 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-69c37d26-5d41-4bf4-8291-53e058fe7399 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:45.691829 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-69c37d26-5d41-4bf4-8291-53e058fe7399 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:45.692636 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-69c37d26-5d41-4bf4-8291-53e058fe7399 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:45.693079 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-69c37d26-5d41-4bf4-8291-53e058fe7399 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:45.822278 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-69c37d26-5d41-4bf4-8291-53e058fe7399 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:45.830479 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-69c37d26-5d41-4bf4-8291-53e058fe7399 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.148837 Jan 19 13:08:45.831089 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 369/742] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:45 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:45.989179 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-875eaa7a-4564-4b46-a775-923591ffda95 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:45.989787 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-875eaa7a-4564-4b46-a775-923591ffda95 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:45.995949 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-875eaa7a-4564-4b46-a775-923591ffda95 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:45.996435 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-875eaa7a-4564-4b46-a775-923591ffda95 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:45.997206 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-875eaa7a-4564-4b46-a775-923591ffda95 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:45.997641 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-875eaa7a-4564-4b46-a775-923591ffda95 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:46.021320 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-74656358-9641-416c-868b-3757e4bd1536 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:46.022017 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-74656358-9641-416c-868b-3757e4bd1536 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:46.027774 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-74656358-9641-416c-868b-3757e4bd1536 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:46.028315 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-74656358-9641-416c-868b-3757e4bd1536 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:46.029161 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-74656358-9641-416c-868b-3757e4bd1536 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:46.029752 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-74656358-9641-416c-868b-3757e4bd1536 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:46.193825 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-875eaa7a-4564-4b46-a775-923591ffda95 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:46.201596 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-875eaa7a-4564-4b46-a775-923591ffda95 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:46.203111 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-875eaa7a-4564-4b46-a775-923591ffda95 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:46.204289 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-875eaa7a-4564-4b46-a775-923591ffda95 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1742 microversion: 2.20 time: 0.218792 Jan 19 13:08:46.204855 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 374/743] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:45 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1742 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:46.204991 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-74656358-9641-416c-868b-3757e4bd1536 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:46.213322 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-74656358-9641-416c-868b-3757e4bd1536 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.196167 Jan 19 13:08:46.213882 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 370/744] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:46 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:46.847525 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2afd9c13-5902-40ff-9d2e-11e258efeebb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:46.848955 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2afd9c13-5902-40ff-9d2e-11e258efeebb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:46.854975 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2afd9c13-5902-40ff-9d2e-11e258efeebb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:46.855432 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2afd9c13-5902-40ff-9d2e-11e258efeebb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:46.856271 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2afd9c13-5902-40ff-9d2e-11e258efeebb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:46.856715 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2afd9c13-5902-40ff-9d2e-11e258efeebb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:47.000148 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2afd9c13-5902-40ff-9d2e-11e258efeebb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:47.010107 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2afd9c13-5902-40ff-9d2e-11e258efeebb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.166484 Jan 19 13:08:47.010929 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 375/745] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:46 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:47.225040 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-84f97630-9876-4f70-92e6-bff6a4b95b3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:47.225637 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-84f97630-9876-4f70-92e6-bff6a4b95b3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:47.230133 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-fde6e216-320b-4286-84c8-8c190762d51b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:47.231106 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-fde6e216-320b-4286-84c8-8c190762d51b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:47.232262 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-84f97630-9876-4f70-92e6-bff6a4b95b3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:47.232717 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-84f97630-9876-4f70-92e6-bff6a4b95b3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:47.233505 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-84f97630-9876-4f70-92e6-bff6a4b95b3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:47.234720 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-84f97630-9876-4f70-92e6-bff6a4b95b3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:47.240913 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fde6e216-320b-4286-84c8-8c190762d51b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:47.241653 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fde6e216-320b-4286-84c8-8c190762d51b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:47.242643 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fde6e216-320b-4286-84c8-8c190762d51b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:47.243077 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fde6e216-320b-4286-84c8-8c190762d51b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:47.446460 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-84f97630-9876-4f70-92e6-bff6a4b95b3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:47.456521 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-84f97630-9876-4f70-92e6-bff6a4b95b3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:47.465150 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-84f97630-9876-4f70-92e6-bff6a4b95b3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:47.466599 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-84f97630-9876-4f70-92e6-bff6a4b95b3d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1742 microversion: 2.20 time: 0.246938 Jan 19 13:08:47.467729 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 371/746] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:47 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1742 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:47.482383 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-fde6e216-320b-4286-84c8-8c190762d51b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:47.490741 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-fde6e216-320b-4286-84c8-8c190762d51b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.264234 Jan 19 13:08:47.491316 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 376/747] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:47 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:48.027677 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ec588475-19dd-4014-b9ba-ad4dbeebf9d7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:48.028323 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ec588475-19dd-4014-b9ba-ad4dbeebf9d7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:48.035723 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ec588475-19dd-4014-b9ba-ad4dbeebf9d7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:48.036215 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ec588475-19dd-4014-b9ba-ad4dbeebf9d7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:48.047211 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ec588475-19dd-4014-b9ba-ad4dbeebf9d7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:48.047685 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ec588475-19dd-4014-b9ba-ad4dbeebf9d7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:48.180897 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ec588475-19dd-4014-b9ba-ad4dbeebf9d7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:48.188679 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ec588475-19dd-4014-b9ba-ad4dbeebf9d7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.164660 Jan 19 13:08:48.189287 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 372/748] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:48 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:48.486990 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0e9921c7-efde-46f8-a318-194a0eba4a2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:48.487704 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0e9921c7-efde-46f8-a318-194a0eba4a2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:48.494117 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0e9921c7-efde-46f8-a318-194a0eba4a2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:48.494782 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0e9921c7-efde-46f8-a318-194a0eba4a2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:48.495656 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0e9921c7-efde-46f8-a318-194a0eba4a2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:48.496208 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0e9921c7-efde-46f8-a318-194a0eba4a2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:48.508948 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-aee13643-3c88-47b2-ae32-50e96b8eeec7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:48.509554 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-aee13643-3c88-47b2-ae32-50e96b8eeec7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:48.533008 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aee13643-3c88-47b2-ae32-50e96b8eeec7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:48.533657 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aee13643-3c88-47b2-ae32-50e96b8eeec7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:48.534464 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aee13643-3c88-47b2-ae32-50e96b8eeec7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:48.534957 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aee13643-3c88-47b2-ae32-50e96b8eeec7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:48.690120 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0e9921c7-efde-46f8-a318-194a0eba4a2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:48.702088 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0e9921c7-efde-46f8-a318-194a0eba4a2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:48.703937 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0e9921c7-efde-46f8-a318-194a0eba4a2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:48.707327 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0e9921c7-efde-46f8-a318-194a0eba4a2a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1742 microversion: 2.20 time: 0.222845 Jan 19 13:08:48.709031 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 377/749] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:48 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1742 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:48.733308 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-aee13643-3c88-47b2-ae32-50e96b8eeec7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:48.742237 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-aee13643-3c88-47b2-ae32-50e96b8eeec7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.236939 Jan 19 13:08:48.743632 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 373/750] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:48 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:49.205907 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3a78c0b1-e33a-452d-8c22-0adc2c57f413 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:49.206545 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3a78c0b1-e33a-452d-8c22-0adc2c57f413 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:49.212930 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3a78c0b1-e33a-452d-8c22-0adc2c57f413 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:49.213578 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3a78c0b1-e33a-452d-8c22-0adc2c57f413 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:49.214419 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3a78c0b1-e33a-452d-8c22-0adc2c57f413 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:49.214859 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3a78c0b1-e33a-452d-8c22-0adc2c57f413 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:49.354356 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3a78c0b1-e33a-452d-8c22-0adc2c57f413 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:49.363565 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3a78c0b1-e33a-452d-8c22-0adc2c57f413 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.161470 Jan 19 13:08:49.364548 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 378/751] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:49 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:49.725404 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3958b53a-bdfd-43ca-976e-349528926674 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:49.725975 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3958b53a-bdfd-43ca-976e-349528926674 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:49.732196 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3958b53a-bdfd-43ca-976e-349528926674 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:49.732651 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3958b53a-bdfd-43ca-976e-349528926674 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:49.733428 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3958b53a-bdfd-43ca-976e-349528926674 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:49.733868 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3958b53a-bdfd-43ca-976e-349528926674 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:49.759831 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-681b855e-206b-448c-a8ac-e92e8011a317 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:49.760476 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-681b855e-206b-448c-a8ac-e92e8011a317 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:49.766899 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-681b855e-206b-448c-a8ac-e92e8011a317 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:49.767344 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-681b855e-206b-448c-a8ac-e92e8011a317 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:49.768241 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-681b855e-206b-448c-a8ac-e92e8011a317 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:49.768679 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-681b855e-206b-448c-a8ac-e92e8011a317 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:49.914279 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3958b53a-bdfd-43ca-976e-349528926674 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:49.921996 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3958b53a-bdfd-43ca-976e-349528926674 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:49.923508 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3958b53a-bdfd-43ca-976e-349528926674 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:49.925383 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3958b53a-bdfd-43ca-976e-349528926674 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1742 microversion: 2.20 time: 0.203908 Jan 19 13:08:49.925950 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 374/752] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:49 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1742 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:08:49.940349 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-681b855e-206b-448c-a8ac-e92e8011a317 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:49.947588 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-681b855e-206b-448c-a8ac-e92e8011a317 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.191331 Jan 19 13:08:49.948173 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 379/753] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:49 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:50.380259 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b38f6e6f-f4e6-4461-8f4c-fec86a9f65a2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:50.380887 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b38f6e6f-f4e6-4461-8f4c-fec86a9f65a2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:50.387130 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b38f6e6f-f4e6-4461-8f4c-fec86a9f65a2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:50.387581 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b38f6e6f-f4e6-4461-8f4c-fec86a9f65a2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:50.388444 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b38f6e6f-f4e6-4461-8f4c-fec86a9f65a2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:50.388875 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b38f6e6f-f4e6-4461-8f4c-fec86a9f65a2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:50.591868 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b38f6e6f-f4e6-4461-8f4c-fec86a9f65a2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:50.599820 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b38f6e6f-f4e6-4461-8f4c-fec86a9f65a2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.223325 Jan 19 13:08:50.600412 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 375/754] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:50 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:50.942398 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b3ce93e7-edc7-4bf2-a8e3-cbe94cd52a6c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:50.943007 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b3ce93e7-edc7-4bf2-a8e3-cbe94cd52a6c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:50.949509 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b3ce93e7-edc7-4bf2-a8e3-cbe94cd52a6c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:50.949973 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b3ce93e7-edc7-4bf2-a8e3-cbe94cd52a6c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:50.950764 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b3ce93e7-edc7-4bf2-a8e3-cbe94cd52a6c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:50.951204 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b3ce93e7-edc7-4bf2-a8e3-cbe94cd52a6c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:50.964323 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-bc947165-066c-445c-8225-937d4e2fe6c1 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:50.966454 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-bc947165-066c-445c-8225-937d4e2fe6c1 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:50.973050 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bc947165-066c-445c-8225-937d4e2fe6c1 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:50.973641 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bc947165-066c-445c-8225-937d4e2fe6c1 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:50.974662 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bc947165-066c-445c-8225-937d4e2fe6c1 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:50.975317 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bc947165-066c-445c-8225-937d4e2fe6c1 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:51.224455 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b3ce93e7-edc7-4bf2-a8e3-cbe94cd52a6c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:51.232275 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b3ce93e7-edc7-4bf2-a8e3-cbe94cd52a6c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:51.233785 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b3ce93e7-edc7-4bf2-a8e3-cbe94cd52a6c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:51.234942 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b3ce93e7-edc7-4bf2-a8e3-cbe94cd52a6c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1742 microversion: 2.20 time: 0.296289 Jan 19 13:08:51.235715 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 380/755] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:50 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1742 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:51.236243 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bc947165-066c-445c-8225-937d4e2fe6c1 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:51.245987 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-bc947165-066c-445c-8225-937d4e2fe6c1 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.284939 Jan 19 13:08:51.246792 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 376/756] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:50 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:51.617398 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d31e9143-f00e-4150-9abf-4c8c5b71ff78 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:51.617949 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d31e9143-f00e-4150-9abf-4c8c5b71ff78 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:51.624433 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d31e9143-f00e-4150-9abf-4c8c5b71ff78 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:51.624889 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d31e9143-f00e-4150-9abf-4c8c5b71ff78 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:51.625673 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d31e9143-f00e-4150-9abf-4c8c5b71ff78 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:51.626277 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d31e9143-f00e-4150-9abf-4c8c5b71ff78 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:51.767174 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d31e9143-f00e-4150-9abf-4c8c5b71ff78 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:51.776578 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d31e9143-f00e-4150-9abf-4c8c5b71ff78 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.162952 Jan 19 13:08:51.777695 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 381/757] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:51 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:52.254886 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-31b79871-6df0-4f68-a2d3-f397c93b578b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:52.255633 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-31b79871-6df0-4f68-a2d3-f397c93b578b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:52.263190 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-31b79871-6df0-4f68-a2d3-f397c93b578b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:52.263641 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-31b79871-6df0-4f68-a2d3-f397c93b578b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:52.263803 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-02db2f70-be56-42de-9ad6-2354fbf9e090 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:52.264333 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-02db2f70-be56-42de-9ad6-2354fbf9e090 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:52.264467 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-31b79871-6df0-4f68-a2d3-f397c93b578b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:52.264875 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-31b79871-6df0-4f68-a2d3-f397c93b578b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:52.271503 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-02db2f70-be56-42de-9ad6-2354fbf9e090 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:52.272015 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-02db2f70-be56-42de-9ad6-2354fbf9e090 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:52.272800 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-02db2f70-be56-42de-9ad6-2354fbf9e090 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:52.273244 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-02db2f70-be56-42de-9ad6-2354fbf9e090 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:52.466814 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-31b79871-6df0-4f68-a2d3-f397c93b578b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:52.471954 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-02db2f70-be56-42de-9ad6-2354fbf9e090 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:52.479704 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-02db2f70-be56-42de-9ad6-2354fbf9e090 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.219830 Jan 19 13:08:52.480233 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-31b79871-6df0-4f68-a2d3-f397c93b578b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:52.481043 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 382/758] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:52 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:52.481947 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-31b79871-6df0-4f68-a2d3-f397c93b578b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:52.483254 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-31b79871-6df0-4f68-a2d3-f397c93b578b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1737 microversion: 2.20 time: 0.233430 Jan 19 13:08:52.484028 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 377/759] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:52 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:52.794734 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-bc62f04e-0445-4fe1-a541-f2f74fefcbbf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:52.795341 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-bc62f04e-0445-4fe1-a541-f2f74fefcbbf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:52.802699 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bc62f04e-0445-4fe1-a541-f2f74fefcbbf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:52.803155 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bc62f04e-0445-4fe1-a541-f2f74fefcbbf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:52.804001 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bc62f04e-0445-4fe1-a541-f2f74fefcbbf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:52.804476 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bc62f04e-0445-4fe1-a541-f2f74fefcbbf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:52.960990 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-bc62f04e-0445-4fe1-a541-f2f74fefcbbf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:52.970306 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-bc62f04e-0445-4fe1-a541-f2f74fefcbbf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.179321 Jan 19 13:08:52.972406 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 383/760] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:52 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:53.498550 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d218db5a-a939-4fa1-a1d3-5cfb241a61cb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:53.499894 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d218db5a-a939-4fa1-a1d3-5cfb241a61cb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:53.502742 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2804d2ba-b874-476a-8a40-ec3ae392eeb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:53.507772 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d218db5a-a939-4fa1-a1d3-5cfb241a61cb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:53.508242 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d218db5a-a939-4fa1-a1d3-5cfb241a61cb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:53.509412 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d218db5a-a939-4fa1-a1d3-5cfb241a61cb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:53.509987 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d218db5a-a939-4fa1-a1d3-5cfb241a61cb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:53.514811 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2804d2ba-b874-476a-8a40-ec3ae392eeb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:53.522755 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2804d2ba-b874-476a-8a40-ec3ae392eeb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:53.523524 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2804d2ba-b874-476a-8a40-ec3ae392eeb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:53.524604 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2804d2ba-b874-476a-8a40-ec3ae392eeb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:53.526545 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2804d2ba-b874-476a-8a40-ec3ae392eeb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:53.707163 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d218db5a-a939-4fa1-a1d3-5cfb241a61cb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:53.719213 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d218db5a-a939-4fa1-a1d3-5cfb241a61cb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.224631 Jan 19 13:08:53.722063 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 378/761] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:53 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:53.772540 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2804d2ba-b874-476a-8a40-ec3ae392eeb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:53.780303 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2804d2ba-b874-476a-8a40-ec3ae392eeb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:53.782138 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2804d2ba-b874-476a-8a40-ec3ae392eeb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:53.783325 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2804d2ba-b874-476a-8a40-ec3ae392eeb5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1737 microversion: 2.20 time: 0.284889 Jan 19 13:08:53.783871 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 384/762] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:53 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1737 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:08:53.990154 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9be9156e-f020-4c70-9319-99006fb59fa8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:53.990623 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9be9156e-f020-4c70-9319-99006fb59fa8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:53.997082 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9be9156e-f020-4c70-9319-99006fb59fa8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:53.997782 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9be9156e-f020-4c70-9319-99006fb59fa8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:53.999054 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9be9156e-f020-4c70-9319-99006fb59fa8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:53.999688 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9be9156e-f020-4c70-9319-99006fb59fa8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:54.167895 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-9be9156e-f020-4c70-9319-99006fb59fa8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:54.181700 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9be9156e-f020-4c70-9319-99006fb59fa8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.196125 Jan 19 13:08:54.185942 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 379/763] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:53 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:54.738025 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0be846a5-a378-4f94-9f9c-ce52adeb0ed9 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:54.738787 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0be846a5-a378-4f94-9f9c-ce52adeb0ed9 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:54.747680 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0be846a5-a378-4f94-9f9c-ce52adeb0ed9 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:54.748408 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0be846a5-a378-4f94-9f9c-ce52adeb0ed9 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:54.749385 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0be846a5-a378-4f94-9f9c-ce52adeb0ed9 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:54.750001 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0be846a5-a378-4f94-9f9c-ce52adeb0ed9 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:54.803528 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f9a44b9a-6ead-4c95-896e-c3766c50291a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:54.804797 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f9a44b9a-6ead-4c95-896e-c3766c50291a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:54.814073 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9a44b9a-6ead-4c95-896e-c3766c50291a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:54.816647 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9a44b9a-6ead-4c95-896e-c3766c50291a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:54.818331 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9a44b9a-6ead-4c95-896e-c3766c50291a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:54.818941 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9a44b9a-6ead-4c95-896e-c3766c50291a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:55.009947 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0be846a5-a378-4f94-9f9c-ce52adeb0ed9 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:55.017924 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0be846a5-a378-4f94-9f9c-ce52adeb0ed9 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.284605 Jan 19 13:08:55.028199 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 385/764] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:54 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:55.093126 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f9a44b9a-6ead-4c95-896e-c3766c50291a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:55.103179 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f9a44b9a-6ead-4c95-896e-c3766c50291a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:55.105016 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f9a44b9a-6ead-4c95-896e-c3766c50291a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:55.106401 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f9a44b9a-6ead-4c95-896e-c3766c50291a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1737 microversion: 2.20 time: 0.307676 Jan 19 13:08:55.118233 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 380/765] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:54 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1737 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:08:55.203009 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0761d5f8-2c74-40f9-8748-684f3b0caa80 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:55.203693 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0761d5f8-2c74-40f9-8748-684f3b0caa80 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:55.216142 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0761d5f8-2c74-40f9-8748-684f3b0caa80 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:55.216688 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0761d5f8-2c74-40f9-8748-684f3b0caa80 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:55.217553 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0761d5f8-2c74-40f9-8748-684f3b0caa80 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:55.218057 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0761d5f8-2c74-40f9-8748-684f3b0caa80 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:55.399285 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0761d5f8-2c74-40f9-8748-684f3b0caa80 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:55.407562 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0761d5f8-2c74-40f9-8748-684f3b0caa80 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1722 microversion: 2.1 time: 0.209071 Jan 19 13:08:55.419887 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 386/766] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:55 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:56.042323 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f08beb11-3335-43c5-8799-efa1e16f1707 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:56.043099 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f08beb11-3335-43c5-8799-efa1e16f1707 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:56.058948 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f08beb11-3335-43c5-8799-efa1e16f1707 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:56.059538 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f08beb11-3335-43c5-8799-efa1e16f1707 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:56.060454 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f08beb11-3335-43c5-8799-efa1e16f1707 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:56.061008 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f08beb11-3335-43c5-8799-efa1e16f1707 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:56.125375 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-384c4b5a-00b4-4b9a-b852-50013d934fac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:56.128797 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-384c4b5a-00b4-4b9a-b852-50013d934fac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:56.137154 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-384c4b5a-00b4-4b9a-b852-50013d934fac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:56.137923 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-384c4b5a-00b4-4b9a-b852-50013d934fac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:56.138951 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-384c4b5a-00b4-4b9a-b852-50013d934fac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:56.139592 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-384c4b5a-00b4-4b9a-b852-50013d934fac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:56.383596 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-384c4b5a-00b4-4b9a-b852-50013d934fac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:56.395057 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-384c4b5a-00b4-4b9a-b852-50013d934fac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:56.411698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f08beb11-3335-43c5-8799-efa1e16f1707 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:56.416051 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-384c4b5a-00b4-4b9a-b852-50013d934fac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:56.417568 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-384c4b5a-00b4-4b9a-b852-50013d934fac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1737 microversion: 2.20 time: 0.295771 Jan 19 13:08:56.429316 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f08beb11-3335-43c5-8799-efa1e16f1707 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.394387 Jan 19 13:08:56.429691 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 387/767] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:56 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1737 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:08:56.433745 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 381/768] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:56 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:56.441854 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-811d7b4f-15fb-402d-8e67-f50a24a19c85 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:56.444836 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-811d7b4f-15fb-402d-8e67-f50a24a19c85 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:56.445400 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-24d3be00-916e-4d20-825f-f49a642b7e02 req-649e6966-c47a-420f-afa1-ffd97a638aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4306e3-3a88-4757-9de6-b3d2be139e7a", "name": "network-vif-plugged", "status": "completed", "tag": "03697968-160d-4c34-bd56-d5220e2b4d4c"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:56.447201 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:08:56.447201 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:08:56.456978 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-24d3be00-916e-4d20-825f-f49a642b7e02 req-649e6966-c47a-420f-afa1-ffd97a638aaf service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:56.457611 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-24d3be00-916e-4d20-825f-f49a642b7e02 req-649e6966-c47a-420f-afa1-ffd97a638aaf service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:56.458235 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-811d7b4f-15fb-402d-8e67-f50a24a19c85 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:56.459097 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-811d7b4f-15fb-402d-8e67-f50a24a19c85 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:56.460937 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-811d7b4f-15fb-402d-8e67-f50a24a19c85 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:56.462427 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-811d7b4f-15fb-402d-8e67-f50a24a19c85 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:56.472197 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-24d3be00-916e-4d20-825f-f49a642b7e02 req-649e6966-c47a-420f-afa1-ffd97a638aaf service nova] Creating event network-vif-plugged:03697968-160d-4c34-bd56-d5220e2b4d4c for instance 3d4306e3-3a88-4757-9de6-b3d2be139e7a on hv-cinder-82301 Jan 19 13:08:56.478056 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-24d3be00-916e-4d20-825f-f49a642b7e02 req-649e6966-c47a-420f-afa1-ffd97a638aaf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046953 Jan 19 13:08:56.479355 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 388/769] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:08:56.712370 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-811d7b4f-15fb-402d-8e67-f50a24a19c85 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:56.723667 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-811d7b4f-15fb-402d-8e67-f50a24a19c85 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1699 microversion: 2.1 time: 0.288639 Jan 19 13:08:56.724555 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 382/770] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:56 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1699 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:56.745120 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-dad589d8-191f-46bd-9e47-965b16323faf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:08:56.758571 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dad589d8-191f-46bd-9e47-965b16323faf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:56.759523 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dad589d8-191f-46bd-9e47-965b16323faf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:56.793841 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-dad589d8-191f-46bd-9e47-965b16323faf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Going to try to start instance {{(pid=116361) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 19 13:08:56.873850 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-dad589d8-191f-46bd-9e47-965b16323faf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 202 len: 0 microversion: 2.1 time: 0.134791 Jan 19 13:08:56.876173 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 389/771] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:08:56 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:08:56.885733 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7b197d7e-0a04-44e0-bf56-a62a4f5c847f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:56.886245 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7b197d7e-0a04-44e0-bf56-a62a4f5c847f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:56.897108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7b197d7e-0a04-44e0-bf56-a62a4f5c847f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:56.897749 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7b197d7e-0a04-44e0-bf56-a62a4f5c847f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:56.898899 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7b197d7e-0a04-44e0-bf56-a62a4f5c847f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:56.899500 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7b197d7e-0a04-44e0-bf56-a62a4f5c847f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:57.071578 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7b197d7e-0a04-44e0-bf56-a62a4f5c847f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:57.080673 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7b197d7e-0a04-44e0-bf56-a62a4f5c847f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1708 microversion: 2.1 time: 0.199824 Jan 19 13:08:57.082463 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 383/772] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:56 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1708 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:57.436950 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-37bb33c6-d141-42c6-a60b-0cd04932962a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:57.438666 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-37bb33c6-d141-42c6-a60b-0cd04932962a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:57.446282 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-760007d2-5df0-4936-95f2-a8932b9e63ac tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:57.446882 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-760007d2-5df0-4936-95f2-a8932b9e63ac tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:57.456358 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-760007d2-5df0-4936-95f2-a8932b9e63ac tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:57.457897 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-37bb33c6-d141-42c6-a60b-0cd04932962a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:57.458614 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-760007d2-5df0-4936-95f2-a8932b9e63ac tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:57.459291 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-37bb33c6-d141-42c6-a60b-0cd04932962a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:57.459425 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-760007d2-5df0-4936-95f2-a8932b9e63ac tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:57.459862 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-760007d2-5df0-4936-95f2-a8932b9e63ac tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:57.460709 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-37bb33c6-d141-42c6-a60b-0cd04932962a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:57.461680 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-37bb33c6-d141-42c6-a60b-0cd04932962a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:57.850011 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-37bb33c6-d141-42c6-a60b-0cd04932962a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:57.859210 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-37bb33c6-d141-42c6-a60b-0cd04932962a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:57.862287 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-37bb33c6-d141-42c6-a60b-0cd04932962a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:57.864249 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-37bb33c6-d141-42c6-a60b-0cd04932962a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1737 microversion: 2.20 time: 0.431604 Jan 19 13:08:57.877719 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 390/773] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:57 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1737 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:57.923371 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-760007d2-5df0-4936-95f2-a8932b9e63ac tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:57.934768 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-760007d2-5df0-4936-95f2-a8932b9e63ac tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1358 microversion: 2.1 time: 0.491896 Jan 19 13:08:57.936743 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 384/774] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:57 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1358 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:58.100890 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3881ed4b-6c01-4ae3-a46a-594cec61e958 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:58.102080 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3881ed4b-6c01-4ae3-a46a-594cec61e958 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:58.109382 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3881ed4b-6c01-4ae3-a46a-594cec61e958 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:58.110255 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3881ed4b-6c01-4ae3-a46a-594cec61e958 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:58.112761 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3881ed4b-6c01-4ae3-a46a-594cec61e958 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:58.114211 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3881ed4b-6c01-4ae3-a46a-594cec61e958 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:58.298532 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3881ed4b-6c01-4ae3-a46a-594cec61e958 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:58.315449 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3881ed4b-6c01-4ae3-a46a-594cec61e958 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1708 microversion: 2.1 time: 0.220531 Jan 19 13:08:58.316045 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 391/775] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:58 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1708 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:58.884899 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a916b11b-10d0-4583-884e-95e71e2dc867 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:58.886890 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a916b11b-10d0-4583-884e-95e71e2dc867 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:58.894408 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a916b11b-10d0-4583-884e-95e71e2dc867 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:58.894883 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a916b11b-10d0-4583-884e-95e71e2dc867 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:58.895893 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a916b11b-10d0-4583-884e-95e71e2dc867 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:58.896384 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a916b11b-10d0-4583-884e-95e71e2dc867 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:58.979912 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a0e08f8b-8686-4394-85c2-7ddaa1080389 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:58.981370 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a0e08f8b-8686-4394-85c2-7ddaa1080389 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:58.995009 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a0e08f8b-8686-4394-85c2-7ddaa1080389 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:59.013397 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a0e08f8b-8686-4394-85c2-7ddaa1080389 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:59.016740 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a0e08f8b-8686-4394-85c2-7ddaa1080389 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:59.017399 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a0e08f8b-8686-4394-85c2-7ddaa1080389 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:59.218744 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a916b11b-10d0-4583-884e-95e71e2dc867 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:59.233406 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a916b11b-10d0-4583-884e-95e71e2dc867 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:59.235286 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a916b11b-10d0-4583-884e-95e71e2dc867 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:59.238347 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a916b11b-10d0-4583-884e-95e71e2dc867 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1737 microversion: 2.20 time: 0.357128 Jan 19 13:08:59.239535 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 385/776] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:08:58 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1737 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:08:59.251740 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-a0e08f8b-8686-4394-85c2-7ddaa1080389 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:59.268295 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a0e08f8b-8686-4394-85c2-7ddaa1080389 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1548 microversion: 2.1 time: 0.305645 Jan 19 13:08:59.268879 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 392/777] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:58 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1548 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:08:59.285485 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b3e8727a-ba50-4844-8c6f-326906160323 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:59.286111 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b3e8727a-ba50-4844-8c6f-326906160323 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:59.292814 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b3e8727a-ba50-4844-8c6f-326906160323 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:59.293427 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b3e8727a-ba50-4844-8c6f-326906160323 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:59.295062 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b3e8727a-ba50-4844-8c6f-326906160323 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:59.295653 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b3e8727a-ba50-4844-8c6f-326906160323 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:59.332891 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-12de1f41-70ca-4815-9714-19ff1cd089b8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:59.333840 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-12de1f41-70ca-4815-9714-19ff1cd089b8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:59.340346 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-12de1f41-70ca-4815-9714-19ff1cd089b8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:59.341017 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-12de1f41-70ca-4815-9714-19ff1cd089b8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:59.342073 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-12de1f41-70ca-4815-9714-19ff1cd089b8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:59.342809 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-12de1f41-70ca-4815-9714-19ff1cd089b8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:59.599183 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b3e8727a-ba50-4844-8c6f-326906160323 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:59.608741 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b3e8727a-ba50-4844-8c6f-326906160323 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1548 microversion: 2.1 time: 0.327675 Jan 19 13:08:59.621428 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 386/778] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:59 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1548 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:59.627204 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-8c991e38-a3a7-4d41-be65-72e50f592dba tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:59.632428 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:08:59.632428 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:08:59.634126 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-8c991e38-a3a7-4d41-be65-72e50f592dba tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:59.635132 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-8c991e38-a3a7-4d41-be65-72e50f592dba tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Searching by: {'deleted': False, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c'} {{(pid=116360) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 19 13:08:59.643824 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8c991e38-a3a7-4d41-be65-72e50f592dba tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:59.644687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8c991e38-a3a7-4d41-be65-72e50f592dba tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:59.645720 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8c991e38-a3a7-4d41-be65-72e50f592dba tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:59.646382 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8c991e38-a3a7-4d41-be65-72e50f592dba tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:59.684920 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-12de1f41-70ca-4815-9714-19ff1cd089b8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:08:59.704833 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-12de1f41-70ca-4815-9714-19ff1cd089b8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1712 microversion: 2.1 time: 0.375637 Jan 19 13:08:59.706788 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 393/779] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:59 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1712 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:08:59.779715 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.multi_cell_list [None req-8c991e38-a3a7-4d41-be65-72e50f592dba tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 19 13:08:59.904713 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-8c991e38-a3a7-4d41-be65-72e50f592dba tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.280911 Jan 19 13:08:59.906071 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 387/780] 10.222.0.48 () {58 vars in 1124 bytes} [Wed Jan 19 13:08:59 2022] GET /compute/v2.1/servers => generated 342 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:08:59.919901 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0ca5b85d-d492-4bcc-8590-c42f9c809566 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:08:59.920545 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0ca5b85d-d492-4bcc-8590-c42f9c809566 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:08:59.927914 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0ca5b85d-d492-4bcc-8590-c42f9c809566 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:59.928391 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0ca5b85d-d492-4bcc-8590-c42f9c809566 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:08:59.929338 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0ca5b85d-d492-4bcc-8590-c42f9c809566 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:08:59.929892 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0ca5b85d-d492-4bcc-8590-c42f9c809566 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:00.088980 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0ca5b85d-d492-4bcc-8590-c42f9c809566 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:00.100010 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0ca5b85d-d492-4bcc-8590-c42f9c809566 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1548 microversion: 2.1 time: 0.186454 Jan 19 13:09:00.100596 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 394/781] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:08:59 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1548 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:09:00.258715 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f94ba946-d670-4c47-82fa-477a4fe7af9d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:00.259343 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f94ba946-d670-4c47-82fa-477a4fe7af9d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:00.266055 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f94ba946-d670-4c47-82fa-477a4fe7af9d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:00.266842 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f94ba946-d670-4c47-82fa-477a4fe7af9d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:00.269129 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f94ba946-d670-4c47-82fa-477a4fe7af9d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:00.269751 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f94ba946-d670-4c47-82fa-477a4fe7af9d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:00.454664 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f94ba946-d670-4c47-82fa-477a4fe7af9d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:00.464027 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f94ba946-d670-4c47-82fa-477a4fe7af9d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:00.467701 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f94ba946-d670-4c47-82fa-477a4fe7af9d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:00.479929 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f94ba946-d670-4c47-82fa-477a4fe7af9d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1737 microversion: 2.20 time: 0.213968 Jan 19 13:09:00.480598 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 388/782] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:00 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:01.498571 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ea6a3dc5-5239-4da0-b5ea-47c0d77c89fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:01.499383 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ea6a3dc5-5239-4da0-b5ea-47c0d77c89fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:01.510880 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ea6a3dc5-5239-4da0-b5ea-47c0d77c89fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:01.511427 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ea6a3dc5-5239-4da0-b5ea-47c0d77c89fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:01.512323 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ea6a3dc5-5239-4da0-b5ea-47c0d77c89fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:01.512973 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ea6a3dc5-5239-4da0-b5ea-47c0d77c89fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:01.698641 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ea6a3dc5-5239-4da0-b5ea-47c0d77c89fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:01.710408 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ea6a3dc5-5239-4da0-b5ea-47c0d77c89fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:01.712239 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ea6a3dc5-5239-4da0-b5ea-47c0d77c89fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:01.713573 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ea6a3dc5-5239-4da0-b5ea-47c0d77c89fb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1737 microversion: 2.20 time: 0.218693 Jan 19 13:09:01.714610 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 395/783] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:01 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:01.862753 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-8e14d9d7-64db-4dd1-986f-b07281d3bc3e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d66ab44-b266-4673-9d51-8cc777a55c9a"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:09:01.863840 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-8e14d9d7-64db-4dd1-986f-b07281d3bc3e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:01.870488 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8e14d9d7-64db-4dd1-986f-b07281d3bc3e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:01.870938 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8e14d9d7-64db-4dd1-986f-b07281d3bc3e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:01.871739 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8e14d9d7-64db-4dd1-986f-b07281d3bc3e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:01.872357 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8e14d9d7-64db-4dd1-986f-b07281d3bc3e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:02.235721 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-8e14d9d7-64db-4dd1-986f-b07281d3bc3e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "POST /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372114 Jan 19 13:09:02.237130 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 389/784] 10.222.0.48 () {60 vars in 1322 bytes} [Wed Jan 19 13:09:01 2022] POST /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:09:02.732923 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3ffc5474-2d59-46a3-b82d-95812f202e48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:02.733729 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3ffc5474-2d59-46a3-b82d-95812f202e48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:02.740687 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3ffc5474-2d59-46a3-b82d-95812f202e48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:02.741197 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3ffc5474-2d59-46a3-b82d-95812f202e48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:02.743081 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3ffc5474-2d59-46a3-b82d-95812f202e48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:02.743699 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3ffc5474-2d59-46a3-b82d-95812f202e48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:02.906984 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3ffc5474-2d59-46a3-b82d-95812f202e48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:02.916723 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3ffc5474-2d59-46a3-b82d-95812f202e48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:02.918276 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3ffc5474-2d59-46a3-b82d-95812f202e48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:02.919458 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3ffc5474-2d59-46a3-b82d-95812f202e48 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1737 microversion: 2.20 time: 0.190960 Jan 19 13:09:02.920124 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 396/785] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:02 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:03.939406 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ad67e986-3118-40d8-9f70-6d52a3da662b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:03.940127 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ad67e986-3118-40d8-9f70-6d52a3da662b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:03.947625 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad67e986-3118-40d8-9f70-6d52a3da662b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:03.948101 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad67e986-3118-40d8-9f70-6d52a3da662b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:03.948891 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad67e986-3118-40d8-9f70-6d52a3da662b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:03.949325 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad67e986-3118-40d8-9f70-6d52a3da662b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:04.168873 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ad67e986-3118-40d8-9f70-6d52a3da662b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:04.178924 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ad67e986-3118-40d8-9f70-6d52a3da662b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:04.180059 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ad67e986-3118-40d8-9f70-6d52a3da662b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:04.181292 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ad67e986-3118-40d8-9f70-6d52a3da662b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1719 microversion: 2.20 time: 0.245929 Jan 19 13:09:04.181787 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 390/786] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:03 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1719 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:05.199858 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6514813e-1e5f-4408-b850-bdab242d3a44 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:05.200442 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6514813e-1e5f-4408-b850-bdab242d3a44 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:05.207174 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6514813e-1e5f-4408-b850-bdab242d3a44 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:05.207645 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6514813e-1e5f-4408-b850-bdab242d3a44 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:05.208448 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6514813e-1e5f-4408-b850-bdab242d3a44 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:05.208880 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6514813e-1e5f-4408-b850-bdab242d3a44 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:05.342883 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6514813e-1e5f-4408-b850-bdab242d3a44 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:05.356158 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6514813e-1e5f-4408-b850-bdab242d3a44 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:05.357834 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6514813e-1e5f-4408-b850-bdab242d3a44 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:05.358998 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6514813e-1e5f-4408-b850-bdab242d3a44 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1719 microversion: 2.20 time: 0.163008 Jan 19 13:09:05.359560 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 397/787] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:05 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:06.187923 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-e13d7ec0-1039-4cea-a2f3-345c6f09ec9d req-aa5a8459-e41e-472f-8df1-bb1b6008d3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2fc94f-e55f-4947-9824-ffc6edf35e0c", "name": "network-vif-unplugged", "status": "completed", "tag": "7e0a83a8-36d8-4d5c-baf5-d9396dafdb38"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:09:06.189558 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:09:06.189558 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:09:06.198260 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-e13d7ec0-1039-4cea-a2f3-345c6f09ec9d req-aa5a8459-e41e-472f-8df1-bb1b6008d3b3 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:06.198711 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-e13d7ec0-1039-4cea-a2f3-345c6f09ec9d req-aa5a8459-e41e-472f-8df1-bb1b6008d3b3 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:06.210106 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-e13d7ec0-1039-4cea-a2f3-345c6f09ec9d req-aa5a8459-e41e-472f-8df1-bb1b6008d3b3 service nova] Creating event network-vif-unplugged:7e0a83a8-36d8-4d5c-baf5-d9396dafdb38 for instance 0a2fc94f-e55f-4947-9824-ffc6edf35e0c on hv-cinder-82301 Jan 19 13:09:06.214804 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-e13d7ec0-1039-4cea-a2f3-345c6f09ec9d req-aa5a8459-e41e-472f-8df1-bb1b6008d3b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030445 Jan 19 13:09:06.215391 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 391/788] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:09:06.377105 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1627733e-5f2f-4802-ac8c-4947cc504e90 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:06.377713 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1627733e-5f2f-4802-ac8c-4947cc504e90 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:06.384193 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1627733e-5f2f-4802-ac8c-4947cc504e90 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:06.384647 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1627733e-5f2f-4802-ac8c-4947cc504e90 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:06.385681 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1627733e-5f2f-4802-ac8c-4947cc504e90 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:06.386154 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1627733e-5f2f-4802-ac8c-4947cc504e90 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:06.524334 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-1627733e-5f2f-4802-ac8c-4947cc504e90 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:06.532748 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-1627733e-5f2f-4802-ac8c-4947cc504e90 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:06.534747 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-1627733e-5f2f-4802-ac8c-4947cc504e90 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:06.536171 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1627733e-5f2f-4802-ac8c-4947cc504e90 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1719 microversion: 2.20 time: 0.162795 Jan 19 13:09:06.540239 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 398/789] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:06 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:07.555475 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f2c32c2f-a591-4f1c-8fe4-5ee532a9ae8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:07.556207 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f2c32c2f-a591-4f1c-8fe4-5ee532a9ae8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:07.562239 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f2c32c2f-a591-4f1c-8fe4-5ee532a9ae8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:07.562693 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f2c32c2f-a591-4f1c-8fe4-5ee532a9ae8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:07.563469 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f2c32c2f-a591-4f1c-8fe4-5ee532a9ae8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:07.563910 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f2c32c2f-a591-4f1c-8fe4-5ee532a9ae8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:07.693160 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f2c32c2f-a591-4f1c-8fe4-5ee532a9ae8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:07.700892 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f2c32c2f-a591-4f1c-8fe4-5ee532a9ae8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:07.702394 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f2c32c2f-a591-4f1c-8fe4-5ee532a9ae8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:07.703532 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f2c32c2f-a591-4f1c-8fe4-5ee532a9ae8f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1662 microversion: 2.20 time: 0.152620 Jan 19 13:09:07.704133 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 392/790] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:07 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:07.723047 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9cbff794-253f-4651-a6ff-bd13eb038ab2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc2ab7c6-19ba-41bc-a4a3-32c6f7638c46"}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:09:07.724225 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9cbff794-253f-4651-a6ff-bd13eb038ab2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:07.730905 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9cbff794-253f-4651-a6ff-bd13eb038ab2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:07.731352 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9cbff794-253f-4651-a6ff-bd13eb038ab2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:07.732250 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9cbff794-253f-4651-a6ff-bd13eb038ab2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:07.732601 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9cbff794-253f-4651-a6ff-bd13eb038ab2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:07.997786 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9cbff794-253f-4651-a6ff-bd13eb038ab2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.279513 Jan 19 13:09:07.998432 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 399/791] 10.222.0.48 () {62 vars in 1363 bytes} [Wed Jan 19 13:09:07 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/os-volume_attachments => generated 188 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:09:08.104590 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0d2ccf28-6fa9-441b-bb23-d50541dc7a13 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:09:08.105158 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0d2ccf28-6fa9-441b-bb23-d50541dc7a13 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:08.110934 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0d2ccf28-6fa9-441b-bb23-d50541dc7a13 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:08.111387 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0d2ccf28-6fa9-441b-bb23-d50541dc7a13 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:08.112196 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0d2ccf28-6fa9-441b-bb23-d50541dc7a13 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:08.112948 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0d2ccf28-6fa9-441b-bb23-d50541dc7a13 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:08.208076 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0d2ccf28-6fa9-441b-bb23-d50541dc7a13 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action" status: 202 len: 0 microversion: 2.20 time: 0.107055 Jan 19 13:09:08.208690 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 393/792] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:09:08 2022] POST /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:09:08.216564 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4f358d90-1291-4586-9428-33e865897caa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:08.217196 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4f358d90-1291-4586-9428-33e865897caa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:08.224512 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f358d90-1291-4586-9428-33e865897caa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:08.224971 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f358d90-1291-4586-9428-33e865897caa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:08.225751 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f358d90-1291-4586-9428-33e865897caa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:08.226184 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f358d90-1291-4586-9428-33e865897caa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:08.355074 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4f358d90-1291-4586-9428-33e865897caa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:08.363829 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4f358d90-1291-4586-9428-33e865897caa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:08.365454 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4f358d90-1291-4586-9428-33e865897caa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:08.366637 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4f358d90-1291-4586-9428-33e865897caa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1748 microversion: 2.20 time: 0.153758 Jan 19 13:09:08.367206 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 400/793] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:08 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:09:09.389249 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-67bd3fc1-9ca5-4a01-8565-93920158fd0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:09.389857 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-67bd3fc1-9ca5-4a01-8565-93920158fd0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:09.396470 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-67bd3fc1-9ca5-4a01-8565-93920158fd0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:09.396922 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-67bd3fc1-9ca5-4a01-8565-93920158fd0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:09.397702 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-67bd3fc1-9ca5-4a01-8565-93920158fd0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:09.398144 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-67bd3fc1-9ca5-4a01-8565-93920158fd0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:09.531686 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-67bd3fc1-9ca5-4a01-8565-93920158fd0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:09.539882 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-67bd3fc1-9ca5-4a01-8565-93920158fd0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:09.541412 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-67bd3fc1-9ca5-4a01-8565-93920158fd0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:09.542539 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-67bd3fc1-9ca5-4a01-8565-93920158fd0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1750 microversion: 2.20 time: 0.157992 Jan 19 13:09:09.543090 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 394/794] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:09 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:09:09.779252 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d14d1fe5-4239-410b-86d4-6368eec6dffb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:09.779859 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d14d1fe5-4239-410b-86d4-6368eec6dffb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:09.786798 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d14d1fe5-4239-410b-86d4-6368eec6dffb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:09.787352 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d14d1fe5-4239-410b-86d4-6368eec6dffb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:09.788366 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d14d1fe5-4239-410b-86d4-6368eec6dffb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:09.788803 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d14d1fe5-4239-410b-86d4-6368eec6dffb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:09.927386 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d14d1fe5-4239-410b-86d4-6368eec6dffb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:09.934994 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d14d1fe5-4239-410b-86d4-6368eec6dffb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1594 microversion: 2.1 time: 0.159594 Jan 19 13:09:09.935553 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 401/795] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:09:09 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:09:10.561062 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ad858ea6-28b5-4625-8d32-fefba00127ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:10.561669 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ad858ea6-28b5-4625-8d32-fefba00127ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:10.568749 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad858ea6-28b5-4625-8d32-fefba00127ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:10.569201 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad858ea6-28b5-4625-8d32-fefba00127ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:10.569990 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad858ea6-28b5-4625-8d32-fefba00127ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:10.570431 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad858ea6-28b5-4625-8d32-fefba00127ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:10.874495 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ad858ea6-28b5-4625-8d32-fefba00127ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:10.884897 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ad858ea6-28b5-4625-8d32-fefba00127ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:10.886971 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ad858ea6-28b5-4625-8d32-fefba00127ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:10.888823 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ad858ea6-28b5-4625-8d32-fefba00127ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.331455 Jan 19 13:09:10.889580 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 395/796] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:10 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:11.907883 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-47987b55-8ac4-468e-80cf-b2601975a922 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:11.909461 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-47987b55-8ac4-468e-80cf-b2601975a922 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:11.918183 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-47987b55-8ac4-468e-80cf-b2601975a922 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:11.918751 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-47987b55-8ac4-468e-80cf-b2601975a922 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:11.919721 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-47987b55-8ac4-468e-80cf-b2601975a922 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:11.920252 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-47987b55-8ac4-468e-80cf-b2601975a922 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:12.150035 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-47987b55-8ac4-468e-80cf-b2601975a922 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:12.161299 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-47987b55-8ac4-468e-80cf-b2601975a922 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:12.167130 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-47987b55-8ac4-468e-80cf-b2601975a922 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:12.168574 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-47987b55-8ac4-468e-80cf-b2601975a922 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.265799 Jan 19 13:09:12.171517 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 402/797] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:11 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:12.847109 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-f92508ff-d8c6-4628-9833-e0284d168d79 req-6f35736f-1572-4977-a53f-bea1b2e93776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d4306e3-3a88-4757-9de6-b3d2be139e7a", "tag": "03697968-160d-4c34-bd56-d5220e2b4d4c"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:09:12.849541 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:09:12.849541 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:09:12.861045 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-f92508ff-d8c6-4628-9833-e0284d168d79 req-6f35736f-1572-4977-a53f-bea1b2e93776 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:12.864831 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-f92508ff-d8c6-4628-9833-e0284d168d79 req-6f35736f-1572-4977-a53f-bea1b2e93776 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:12.889296 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-f92508ff-d8c6-4628-9833-e0284d168d79 req-6f35736f-1572-4977-a53f-bea1b2e93776 service nova] Creating event network-changed:03697968-160d-4c34-bd56-d5220e2b4d4c for instance 3d4306e3-3a88-4757-9de6-b3d2be139e7a on hv-cinder-82301 Jan 19 13:09:12.906744 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-f92508ff-d8c6-4628-9833-e0284d168d79 req-6f35736f-1572-4977-a53f-bea1b2e93776 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063193 Jan 19 13:09:12.907973 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 396/798] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:09:13.197680 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-21a0c634-5c69-4d6f-968f-9e37e4a3f6a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:13.198548 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-21a0c634-5c69-4d6f-968f-9e37e4a3f6a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:13.215892 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-21a0c634-5c69-4d6f-968f-9e37e4a3f6a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:13.216527 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-21a0c634-5c69-4d6f-968f-9e37e4a3f6a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:13.217633 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-21a0c634-5c69-4d6f-968f-9e37e4a3f6a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:13.218213 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-21a0c634-5c69-4d6f-968f-9e37e4a3f6a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:13.471027 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-21a0c634-5c69-4d6f-968f-9e37e4a3f6a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:13.481120 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-21a0c634-5c69-4d6f-968f-9e37e4a3f6a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:13.482641 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-21a0c634-5c69-4d6f-968f-9e37e4a3f6a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:13.483800 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-21a0c634-5c69-4d6f-968f-9e37e4a3f6a6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.297748 Jan 19 13:09:13.484379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 403/799] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:13 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:14.117245 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ff790100-6c20-46ea-bed2-80c05ad43b6b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1235464902"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:09:14.117964 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ff790100-6c20-46ea-bed2-80c05ad43b6b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:14.124650 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff790100-6c20-46ea-bed2-80c05ad43b6b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:14.125197 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff790100-6c20-46ea-bed2-80c05ad43b6b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:14.126067 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff790100-6c20-46ea-bed2-80c05ad43b6b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:14.126578 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff790100-6c20-46ea-bed2-80c05ad43b6b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:14.280636 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.network.security_group_api [None req-ff790100-6c20-46ea-bed2-80c05ad43b6b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Adding security group c688c8af-f5ff-44f9-b284-30ebe35d96e7 to port 03697968-160d-4c34-bd56-d5220e2b4d4c Jan 19 13:09:14.502690 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7a3242e5-73b7-44d9-8c6d-bea78a943196 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:14.504008 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7a3242e5-73b7-44d9-8c6d-bea78a943196 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:14.511504 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7a3242e5-73b7-44d9-8c6d-bea78a943196 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:14.512387 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7a3242e5-73b7-44d9-8c6d-bea78a943196 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:14.513368 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7a3242e5-73b7-44d9-8c6d-bea78a943196 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:14.513954 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7a3242e5-73b7-44d9-8c6d-bea78a943196 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:14.779472 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ff790100-6c20-46ea-bed2-80c05ad43b6b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "POST /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/action" status: 202 len: 0 microversion: 2.1 time: 0.667296 Jan 19 13:09:14.780109 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 397/800] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:09:14 2022] POST /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:09:14.792413 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-7a3242e5-73b7-44d9-8c6d-bea78a943196 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:14.798668 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-15325540-1368-4bb1-a41c-0af3429b0763 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:14.799652 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-15325540-1368-4bb1-a41c-0af3429b0763 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:14.813944 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-7a3242e5-73b7-44d9-8c6d-bea78a943196 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:14.815591 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-15325540-1368-4bb1-a41c-0af3429b0763 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:14.816089 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-15325540-1368-4bb1-a41c-0af3429b0763 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:14.816304 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-7a3242e5-73b7-44d9-8c6d-bea78a943196 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:14.816946 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-15325540-1368-4bb1-a41c-0af3429b0763 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:14.817530 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-15325540-1368-4bb1-a41c-0af3429b0763 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:14.822721 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7a3242e5-73b7-44d9-8c6d-bea78a943196 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.323626 Jan 19 13:09:14.825220 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 404/801] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:14 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:14.923956 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-090ac5fc-7b39-4535-a0ec-b41db9865527 req-46838863-dde0-46f1-896f-6beb972edacc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d4306e3-3a88-4757-9de6-b3d2be139e7a", "tag": "03697968-160d-4c34-bd56-d5220e2b4d4c"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:09:14.925955 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:09:14.925955 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:09:14.937429 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-090ac5fc-7b39-4535-a0ec-b41db9865527 req-46838863-dde0-46f1-896f-6beb972edacc service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:14.938800 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-090ac5fc-7b39-4535-a0ec-b41db9865527 req-46838863-dde0-46f1-896f-6beb972edacc service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:14.958553 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-090ac5fc-7b39-4535-a0ec-b41db9865527 req-46838863-dde0-46f1-896f-6beb972edacc service nova] Creating event network-changed:03697968-160d-4c34-bd56-d5220e2b4d4c for instance 3d4306e3-3a88-4757-9de6-b3d2be139e7a on hv-cinder-82301 Jan 19 13:09:14.974651 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-090ac5fc-7b39-4535-a0ec-b41db9865527 req-46838863-dde0-46f1-896f-6beb972edacc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047087 Jan 19 13:09:14.976224 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 405/802] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:09:15.017480 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-15325540-1368-4bb1-a41c-0af3429b0763 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:15.028189 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-15325540-1368-4bb1-a41c-0af3429b0763 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1641 microversion: 2.1 time: 0.242175 Jan 19 13:09:15.028685 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 398/803] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:09:14 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1641 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:09:15.843796 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d146977e-d7a9-4c82-a83e-ff2f812210cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:15.844517 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d146977e-d7a9-4c82-a83e-ff2f812210cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:15.852551 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d146977e-d7a9-4c82-a83e-ff2f812210cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:15.853007 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d146977e-d7a9-4c82-a83e-ff2f812210cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:15.853806 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d146977e-d7a9-4c82-a83e-ff2f812210cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:15.854278 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d146977e-d7a9-4c82-a83e-ff2f812210cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:16.003433 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d146977e-d7a9-4c82-a83e-ff2f812210cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:16.012885 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d146977e-d7a9-4c82-a83e-ff2f812210cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:16.014697 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d146977e-d7a9-4c82-a83e-ff2f812210cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:16.016201 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d146977e-d7a9-4c82-a83e-ff2f812210cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.177019 Jan 19 13:09:16.027847 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 406/804] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:15 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:17.034392 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0f9b4644-6ba6-4ec9-9c7f-95f64d5693e5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:17.036410 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0f9b4644-6ba6-4ec9-9c7f-95f64d5693e5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:17.042614 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0f9b4644-6ba6-4ec9-9c7f-95f64d5693e5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:17.043070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0f9b4644-6ba6-4ec9-9c7f-95f64d5693e5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:17.043859 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0f9b4644-6ba6-4ec9-9c7f-95f64d5693e5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:17.044336 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0f9b4644-6ba6-4ec9-9c7f-95f64d5693e5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:17.242038 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0f9b4644-6ba6-4ec9-9c7f-95f64d5693e5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:17.251405 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0f9b4644-6ba6-4ec9-9c7f-95f64d5693e5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:17.253211 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0f9b4644-6ba6-4ec9-9c7f-95f64d5693e5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:17.255117 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0f9b4644-6ba6-4ec9-9c7f-95f64d5693e5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.223757 Jan 19 13:09:17.255876 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 399/805] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:17 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:18.278232 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-dfebf392-afa3-44e9-b17e-80afba8cb141 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:18.278847 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-dfebf392-afa3-44e9-b17e-80afba8cb141 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:18.286653 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dfebf392-afa3-44e9-b17e-80afba8cb141 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:18.287139 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dfebf392-afa3-44e9-b17e-80afba8cb141 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:18.288153 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dfebf392-afa3-44e9-b17e-80afba8cb141 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:18.288689 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dfebf392-afa3-44e9-b17e-80afba8cb141 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:18.491676 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-dfebf392-afa3-44e9-b17e-80afba8cb141 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:18.499922 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-dfebf392-afa3-44e9-b17e-80afba8cb141 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:18.501513 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-dfebf392-afa3-44e9-b17e-80afba8cb141 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:18.502753 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-dfebf392-afa3-44e9-b17e-80afba8cb141 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.231271 Jan 19 13:09:18.503508 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 407/806] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:18 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:19.521107 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-26b9f39a-b82e-4a0c-aab7-dac94c003af9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:19.521684 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-26b9f39a-b82e-4a0c-aab7-dac94c003af9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:19.527819 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-26b9f39a-b82e-4a0c-aab7-dac94c003af9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:19.528377 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-26b9f39a-b82e-4a0c-aab7-dac94c003af9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:19.529078 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-26b9f39a-b82e-4a0c-aab7-dac94c003af9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:19.529514 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-26b9f39a-b82e-4a0c-aab7-dac94c003af9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:19.661442 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-26b9f39a-b82e-4a0c-aab7-dac94c003af9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:19.670056 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-26b9f39a-b82e-4a0c-aab7-dac94c003af9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:19.671565 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-26b9f39a-b82e-4a0c-aab7-dac94c003af9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:19.672755 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-26b9f39a-b82e-4a0c-aab7-dac94c003af9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.155571 Jan 19 13:09:19.673495 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 400/807] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:19 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:20.692915 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-17fea963-64fc-439f-88a1-f430146c872f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:20.693731 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-17fea963-64fc-439f-88a1-f430146c872f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:20.700141 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-17fea963-64fc-439f-88a1-f430146c872f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:20.700591 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-17fea963-64fc-439f-88a1-f430146c872f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:20.701381 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-17fea963-64fc-439f-88a1-f430146c872f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:20.701818 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-17fea963-64fc-439f-88a1-f430146c872f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:20.844753 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-17fea963-64fc-439f-88a1-f430146c872f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:20.853652 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-17fea963-64fc-439f-88a1-f430146c872f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:20.855178 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-17fea963-64fc-439f-88a1-f430146c872f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:20.856391 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-17fea963-64fc-439f-88a1-f430146c872f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.169076 Jan 19 13:09:20.856956 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 408/808] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:20 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:21.874509 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-191de1f3-2927-437a-a19f-c850ddfcc04e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:21.875133 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-191de1f3-2927-437a-a19f-c850ddfcc04e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:21.882452 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-191de1f3-2927-437a-a19f-c850ddfcc04e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:21.883143 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-191de1f3-2927-437a-a19f-c850ddfcc04e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:21.884133 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-191de1f3-2927-437a-a19f-c850ddfcc04e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:21.884723 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-191de1f3-2927-437a-a19f-c850ddfcc04e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:22.025333 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-191de1f3-2927-437a-a19f-c850ddfcc04e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:22.033771 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-191de1f3-2927-437a-a19f-c850ddfcc04e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:22.035347 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-191de1f3-2927-437a-a19f-c850ddfcc04e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:22.036633 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-191de1f3-2927-437a-a19f-c850ddfcc04e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.165885 Jan 19 13:09:22.037195 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 401/809] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:21 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:23.055167 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d7f61db9-bfc1-4e44-95a5-907b7ddbdd33 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:23.055969 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d7f61db9-bfc1-4e44-95a5-907b7ddbdd33 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:23.062711 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d7f61db9-bfc1-4e44-95a5-907b7ddbdd33 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:23.063169 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d7f61db9-bfc1-4e44-95a5-907b7ddbdd33 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:23.063969 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d7f61db9-bfc1-4e44-95a5-907b7ddbdd33 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:23.064431 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d7f61db9-bfc1-4e44-95a5-907b7ddbdd33 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:23.199758 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d7f61db9-bfc1-4e44-95a5-907b7ddbdd33 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:23.209081 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d7f61db9-bfc1-4e44-95a5-907b7ddbdd33 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:23.210595 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d7f61db9-bfc1-4e44-95a5-907b7ddbdd33 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:23.211756 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d7f61db9-bfc1-4e44-95a5-907b7ddbdd33 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.160994 Jan 19 13:09:23.212537 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 409/810] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:23 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:24.231572 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c9965e84-a5aa-492f-9a82-fc242e7790c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:24.232240 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c9965e84-a5aa-492f-9a82-fc242e7790c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:24.238475 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c9965e84-a5aa-492f-9a82-fc242e7790c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:24.238922 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c9965e84-a5aa-492f-9a82-fc242e7790c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:24.239690 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c9965e84-a5aa-492f-9a82-fc242e7790c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:24.240165 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c9965e84-a5aa-492f-9a82-fc242e7790c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:24.368528 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c9965e84-a5aa-492f-9a82-fc242e7790c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:24.376693 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c9965e84-a5aa-492f-9a82-fc242e7790c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:24.378201 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c9965e84-a5aa-492f-9a82-fc242e7790c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:24.379343 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c9965e84-a5aa-492f-9a82-fc242e7790c8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.151501 Jan 19 13:09:24.379906 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 402/811] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:24 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:25.398109 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0777f83a-f1d3-4205-8289-fdcba9e25ff1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:25.398716 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0777f83a-f1d3-4205-8289-fdcba9e25ff1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:25.405217 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0777f83a-f1d3-4205-8289-fdcba9e25ff1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:25.405662 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0777f83a-f1d3-4205-8289-fdcba9e25ff1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:25.406493 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0777f83a-f1d3-4205-8289-fdcba9e25ff1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:25.406932 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0777f83a-f1d3-4205-8289-fdcba9e25ff1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:25.541579 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0777f83a-f1d3-4205-8289-fdcba9e25ff1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:25.549794 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0777f83a-f1d3-4205-8289-fdcba9e25ff1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:25.551310 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0777f83a-f1d3-4205-8289-fdcba9e25ff1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:25.552498 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0777f83a-f1d3-4205-8289-fdcba9e25ff1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.159072 Jan 19 13:09:25.553124 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 410/812] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:25 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:26.672989 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d8d07ec9-31c8-4b57-b493-9b0cefe69061 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:26.673486 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d8d07ec9-31c8-4b57-b493-9b0cefe69061 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:26.681689 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d8d07ec9-31c8-4b57-b493-9b0cefe69061 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:26.682262 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d8d07ec9-31c8-4b57-b493-9b0cefe69061 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:26.683308 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d8d07ec9-31c8-4b57-b493-9b0cefe69061 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:26.683855 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d8d07ec9-31c8-4b57-b493-9b0cefe69061 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:27.072603 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d8d07ec9-31c8-4b57-b493-9b0cefe69061 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:27.080946 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d8d07ec9-31c8-4b57-b493-9b0cefe69061 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:27.082457 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d8d07ec9-31c8-4b57-b493-9b0cefe69061 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:27.083616 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d8d07ec9-31c8-4b57-b493-9b0cefe69061 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.516914 Jan 19 13:09:27.084213 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 403/813] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:26 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:28.101909 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-59c23f9d-ade1-4a4f-9794-a36782c380ef tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:28.102461 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-59c23f9d-ade1-4a4f-9794-a36782c380ef tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:28.108811 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-59c23f9d-ade1-4a4f-9794-a36782c380ef tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:28.109257 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-59c23f9d-ade1-4a4f-9794-a36782c380ef tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:28.110088 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-59c23f9d-ade1-4a4f-9794-a36782c380ef tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:28.110523 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-59c23f9d-ade1-4a4f-9794-a36782c380ef tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:28.261624 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-59c23f9d-ade1-4a4f-9794-a36782c380ef tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:28.269897 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-59c23f9d-ade1-4a4f-9794-a36782c380ef tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:28.271424 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-59c23f9d-ade1-4a4f-9794-a36782c380ef tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:28.273242 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-59c23f9d-ade1-4a4f-9794-a36782c380ef tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.175211 Jan 19 13:09:28.273979 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 411/814] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:28 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:29.291838 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2fcb6d09-3c39-4986-83cd-5613a317a325 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:29.292470 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2fcb6d09-3c39-4986-83cd-5613a317a325 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:29.301993 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2fcb6d09-3c39-4986-83cd-5613a317a325 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:29.302801 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2fcb6d09-3c39-4986-83cd-5613a317a325 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:29.304293 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2fcb6d09-3c39-4986-83cd-5613a317a325 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:29.304879 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2fcb6d09-3c39-4986-83cd-5613a317a325 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:29.448204 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2fcb6d09-3c39-4986-83cd-5613a317a325 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:29.457231 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2fcb6d09-3c39-4986-83cd-5613a317a325 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:29.458737 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2fcb6d09-3c39-4986-83cd-5613a317a325 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:29.460520 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2fcb6d09-3c39-4986-83cd-5613a317a325 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.172459 Jan 19 13:09:29.461130 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 404/815] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:29 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:30.478834 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-934fbc93-382b-4fd9-b118-823e88f38ba1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:30.479436 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-934fbc93-382b-4fd9-b118-823e88f38ba1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:30.485720 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-934fbc93-382b-4fd9-b118-823e88f38ba1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:30.486177 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-934fbc93-382b-4fd9-b118-823e88f38ba1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:30.486951 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-934fbc93-382b-4fd9-b118-823e88f38ba1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:30.487395 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-934fbc93-382b-4fd9-b118-823e88f38ba1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:30.611319 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-934fbc93-382b-4fd9-b118-823e88f38ba1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:30.620035 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-934fbc93-382b-4fd9-b118-823e88f38ba1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:30.621550 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-934fbc93-382b-4fd9-b118-823e88f38ba1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:30.622701 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-934fbc93-382b-4fd9-b118-823e88f38ba1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.148199 Jan 19 13:09:30.623259 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 412/816] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:30 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:31.641321 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c031af61-1ac9-4fcf-b7d4-5d607bfd2ea3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:31.641923 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c031af61-1ac9-4fcf-b7d4-5d607bfd2ea3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:31.648155 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c031af61-1ac9-4fcf-b7d4-5d607bfd2ea3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:31.649102 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c031af61-1ac9-4fcf-b7d4-5d607bfd2ea3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:31.650371 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c031af61-1ac9-4fcf-b7d4-5d607bfd2ea3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:31.650901 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c031af61-1ac9-4fcf-b7d4-5d607bfd2ea3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:31.780311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c031af61-1ac9-4fcf-b7d4-5d607bfd2ea3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:31.788514 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c031af61-1ac9-4fcf-b7d4-5d607bfd2ea3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:31.790067 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c031af61-1ac9-4fcf-b7d4-5d607bfd2ea3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:31.791204 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c031af61-1ac9-4fcf-b7d4-5d607bfd2ea3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.153595 Jan 19 13:09:31.791757 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 405/817] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:31 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:32.809658 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-23a8c86d-bab9-4d8d-8998-717896f0adbb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:32.810191 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-23a8c86d-bab9-4d8d-8998-717896f0adbb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:32.816548 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-23a8c86d-bab9-4d8d-8998-717896f0adbb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:32.817004 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-23a8c86d-bab9-4d8d-8998-717896f0adbb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:32.817783 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-23a8c86d-bab9-4d8d-8998-717896f0adbb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:32.818223 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-23a8c86d-bab9-4d8d-8998-717896f0adbb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:32.947235 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-23a8c86d-bab9-4d8d-8998-717896f0adbb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:32.955363 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-23a8c86d-bab9-4d8d-8998-717896f0adbb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:32.956895 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-23a8c86d-bab9-4d8d-8998-717896f0adbb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:32.958035 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-23a8c86d-bab9-4d8d-8998-717896f0adbb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.152215 Jan 19 13:09:32.958591 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 413/818] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:32 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:33.975788 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0486ce36-eb8a-48c4-b66c-edae79641c14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:33.976454 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0486ce36-eb8a-48c4-b66c-edae79641c14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:33.983054 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0486ce36-eb8a-48c4-b66c-edae79641c14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:33.983506 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0486ce36-eb8a-48c4-b66c-edae79641c14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:33.984314 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0486ce36-eb8a-48c4-b66c-edae79641c14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:33.984756 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0486ce36-eb8a-48c4-b66c-edae79641c14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:34.113158 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0486ce36-eb8a-48c4-b66c-edae79641c14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:34.122136 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0486ce36-eb8a-48c4-b66c-edae79641c14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:34.123579 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0486ce36-eb8a-48c4-b66c-edae79641c14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:34.124761 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0486ce36-eb8a-48c4-b66c-edae79641c14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.152660 Jan 19 13:09:34.125325 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 406/819] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:33 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:35.143972 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-16744d79-f22a-4893-8527-64eae1e2f30f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:35.144536 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-16744d79-f22a-4893-8527-64eae1e2f30f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:35.151283 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-16744d79-f22a-4893-8527-64eae1e2f30f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:35.151797 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-16744d79-f22a-4893-8527-64eae1e2f30f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:35.152544 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-16744d79-f22a-4893-8527-64eae1e2f30f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:35.152985 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-16744d79-f22a-4893-8527-64eae1e2f30f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:35.284752 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-16744d79-f22a-4893-8527-64eae1e2f30f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:35.293818 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-16744d79-f22a-4893-8527-64eae1e2f30f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:35.295344 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-16744d79-f22a-4893-8527-64eae1e2f30f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:35.296527 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-16744d79-f22a-4893-8527-64eae1e2f30f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.156497 Jan 19 13:09:35.297086 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 414/820] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:35 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:09:36.313888 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-63b0cc1d-4609-4545-9abd-8453d85b71f8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:36.314495 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-63b0cc1d-4609-4545-9abd-8453d85b71f8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:36.320901 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-63b0cc1d-4609-4545-9abd-8453d85b71f8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:36.321584 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-63b0cc1d-4609-4545-9abd-8453d85b71f8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:36.322362 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-63b0cc1d-4609-4545-9abd-8453d85b71f8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:36.322802 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-63b0cc1d-4609-4545-9abd-8453d85b71f8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:36.448902 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-63b0cc1d-4609-4545-9abd-8453d85b71f8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:36.457261 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-63b0cc1d-4609-4545-9abd-8453d85b71f8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:36.458767 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-63b0cc1d-4609-4545-9abd-8453d85b71f8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:36.459914 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-63b0cc1d-4609-4545-9abd-8453d85b71f8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.149709 Jan 19 13:09:36.460501 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 407/821] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:36 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:37.478017 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-33102b31-9958-463a-b18e-6e928ed3d85a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:37.478595 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-33102b31-9958-463a-b18e-6e928ed3d85a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:37.485210 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33102b31-9958-463a-b18e-6e928ed3d85a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:37.485666 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33102b31-9958-463a-b18e-6e928ed3d85a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:37.486449 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33102b31-9958-463a-b18e-6e928ed3d85a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:37.486890 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33102b31-9958-463a-b18e-6e928ed3d85a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:37.615617 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-33102b31-9958-463a-b18e-6e928ed3d85a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:37.624658 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-33102b31-9958-463a-b18e-6e928ed3d85a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:37.626177 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-33102b31-9958-463a-b18e-6e928ed3d85a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:37.627325 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-33102b31-9958-463a-b18e-6e928ed3d85a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.153114 Jan 19 13:09:37.627882 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 415/822] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:37 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:38.646317 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ad495e91-ce0f-4ed7-97d4-1ee556d26e29 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:38.646913 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ad495e91-ce0f-4ed7-97d4-1ee556d26e29 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:38.653837 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad495e91-ce0f-4ed7-97d4-1ee556d26e29 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:38.654278 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad495e91-ce0f-4ed7-97d4-1ee556d26e29 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:38.655043 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad495e91-ce0f-4ed7-97d4-1ee556d26e29 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:38.655471 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad495e91-ce0f-4ed7-97d4-1ee556d26e29 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:38.785265 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ad495e91-ce0f-4ed7-97d4-1ee556d26e29 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:38.793733 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ad495e91-ce0f-4ed7-97d4-1ee556d26e29 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:38.795236 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ad495e91-ce0f-4ed7-97d4-1ee556d26e29 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:38.796415 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ad495e91-ce0f-4ed7-97d4-1ee556d26e29 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.153749 Jan 19 13:09:38.796986 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 408/823] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:38 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:39.814899 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d5d87f75-c146-4069-986d-27e8866786f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:39.815613 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d5d87f75-c146-4069-986d-27e8866786f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:39.822126 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d5d87f75-c146-4069-986d-27e8866786f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:39.822573 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d5d87f75-c146-4069-986d-27e8866786f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:39.823402 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d5d87f75-c146-4069-986d-27e8866786f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:39.823837 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d5d87f75-c146-4069-986d-27e8866786f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:39.962579 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d5d87f75-c146-4069-986d-27e8866786f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:39.970842 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d5d87f75-c146-4069-986d-27e8866786f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:39.972368 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d5d87f75-c146-4069-986d-27e8866786f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:39.973503 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d5d87f75-c146-4069-986d-27e8866786f0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.162603 Jan 19 13:09:39.974056 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 416/824] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:39 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:09:40.991563 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-96f79adb-2cb3-4796-99ad-e5524c4c7e93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:40.992195 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-96f79adb-2cb3-4796-99ad-e5524c4c7e93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:40.999271 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-96f79adb-2cb3-4796-99ad-e5524c4c7e93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:40.999724 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-96f79adb-2cb3-4796-99ad-e5524c4c7e93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:41.000543 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-96f79adb-2cb3-4796-99ad-e5524c4c7e93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:41.001047 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-96f79adb-2cb3-4796-99ad-e5524c4c7e93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:41.131569 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-96f79adb-2cb3-4796-99ad-e5524c4c7e93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:41.140918 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-96f79adb-2cb3-4796-99ad-e5524c4c7e93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:41.142504 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-96f79adb-2cb3-4796-99ad-e5524c4c7e93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:41.143722 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-96f79adb-2cb3-4796-99ad-e5524c4c7e93 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.155983 Jan 19 13:09:41.144496 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 409/825] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:40 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:42.161735 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a316b007-2c97-432d-880c-1ed011474f65 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:42.162264 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a316b007-2c97-432d-880c-1ed011474f65 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:42.169682 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a316b007-2c97-432d-880c-1ed011474f65 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:42.170130 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a316b007-2c97-432d-880c-1ed011474f65 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:42.170907 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a316b007-2c97-432d-880c-1ed011474f65 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:42.171339 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a316b007-2c97-432d-880c-1ed011474f65 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:42.524559 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-a316b007-2c97-432d-880c-1ed011474f65 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:42.532691 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-a316b007-2c97-432d-880c-1ed011474f65 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:42.534182 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-a316b007-2c97-432d-880c-1ed011474f65 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:42.535327 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a316b007-2c97-432d-880c-1ed011474f65 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.377366 Jan 19 13:09:42.535879 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 417/826] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:42 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:43.554107 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-04b8ac7b-3517-4ea9-a92d-6cad332d19fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:43.554708 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-04b8ac7b-3517-4ea9-a92d-6cad332d19fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:43.561231 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-04b8ac7b-3517-4ea9-a92d-6cad332d19fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:43.561685 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-04b8ac7b-3517-4ea9-a92d-6cad332d19fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:43.562457 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-04b8ac7b-3517-4ea9-a92d-6cad332d19fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:43.562897 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-04b8ac7b-3517-4ea9-a92d-6cad332d19fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:43.702033 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-04b8ac7b-3517-4ea9-a92d-6cad332d19fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:43.710303 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-04b8ac7b-3517-4ea9-a92d-6cad332d19fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:43.711876 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-04b8ac7b-3517-4ea9-a92d-6cad332d19fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:43.713176 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-04b8ac7b-3517-4ea9-a92d-6cad332d19fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.162704 Jan 19 13:09:43.713934 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 410/827] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:43 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:44.731477 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-32495e71-1d3d-4510-97bc-58de286a2ada tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:44.732110 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-32495e71-1d3d-4510-97bc-58de286a2ada tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:44.738417 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32495e71-1d3d-4510-97bc-58de286a2ada tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:44.738869 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32495e71-1d3d-4510-97bc-58de286a2ada tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:44.739651 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32495e71-1d3d-4510-97bc-58de286a2ada tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:44.740122 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32495e71-1d3d-4510-97bc-58de286a2ada tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:44.873239 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-32495e71-1d3d-4510-97bc-58de286a2ada tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:44.881483 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-32495e71-1d3d-4510-97bc-58de286a2ada tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:44.882975 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-32495e71-1d3d-4510-97bc-58de286a2ada tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:44.884791 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-32495e71-1d3d-4510-97bc-58de286a2ada tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.157196 Jan 19 13:09:44.885604 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 418/828] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:44 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:45.903588 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a3f5d073-0070-4049-9c0f-458994c03144 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:45.904241 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a3f5d073-0070-4049-9c0f-458994c03144 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:45.910043 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a3f5d073-0070-4049-9c0f-458994c03144 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:45.910485 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a3f5d073-0070-4049-9c0f-458994c03144 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:45.911244 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a3f5d073-0070-4049-9c0f-458994c03144 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:45.911675 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a3f5d073-0070-4049-9c0f-458994c03144 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:46.038192 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a3f5d073-0070-4049-9c0f-458994c03144 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:46.046525 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a3f5d073-0070-4049-9c0f-458994c03144 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:46.048036 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a3f5d073-0070-4049-9c0f-458994c03144 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:46.049163 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a3f5d073-0070-4049-9c0f-458994c03144 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.150449 Jan 19 13:09:46.049714 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 411/829] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:45 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:47.067842 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-14a68a4a-0841-47eb-bc07-19b019862106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:47.068405 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-14a68a4a-0841-47eb-bc07-19b019862106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:47.074681 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-14a68a4a-0841-47eb-bc07-19b019862106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:47.075119 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-14a68a4a-0841-47eb-bc07-19b019862106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:47.075882 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-14a68a4a-0841-47eb-bc07-19b019862106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:47.076335 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-14a68a4a-0841-47eb-bc07-19b019862106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:47.200868 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-14a68a4a-0841-47eb-bc07-19b019862106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:47.208979 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-14a68a4a-0841-47eb-bc07-19b019862106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:47.210477 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-14a68a4a-0841-47eb-bc07-19b019862106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:47.212288 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-14a68a4a-0841-47eb-bc07-19b019862106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.147573 Jan 19 13:09:47.213029 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 419/830] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:47 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:48.231330 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-8f8d8f1a-a772-4a4a-8809-bf56348cfd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:48.232065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-8f8d8f1a-a772-4a4a-8809-bf56348cfd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:48.239562 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8f8d8f1a-a772-4a4a-8809-bf56348cfd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:48.240408 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8f8d8f1a-a772-4a4a-8809-bf56348cfd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:48.241792 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8f8d8f1a-a772-4a4a-8809-bf56348cfd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:48.242583 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8f8d8f1a-a772-4a4a-8809-bf56348cfd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:48.403533 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-8f8d8f1a-a772-4a4a-8809-bf56348cfd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:48.411944 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-8f8d8f1a-a772-4a4a-8809-bf56348cfd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:48.413466 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-8f8d8f1a-a772-4a4a-8809-bf56348cfd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:48.414610 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-8f8d8f1a-a772-4a4a-8809-bf56348cfd92 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.187914 Jan 19 13:09:48.415174 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 412/831] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:48 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:48.424680 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-88f1b9e9-05db-4dcb-869a-31fa02e91971 req-98af9634-229b-478a-a292-ebf2bb18666c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2fc94f-e55f-4947-9824-ffc6edf35e0c", "name": "network-vif-plugged", "status": "completed", "tag": "7e0a83a8-36d8-4d5c-baf5-d9396dafdb38"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:09:48.427019 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:09:48.427019 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:09:48.434767 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-88f1b9e9-05db-4dcb-869a-31fa02e91971 req-98af9634-229b-478a-a292-ebf2bb18666c service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:48.435342 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-88f1b9e9-05db-4dcb-869a-31fa02e91971 req-98af9634-229b-478a-a292-ebf2bb18666c service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:48.449347 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-88f1b9e9-05db-4dcb-869a-31fa02e91971 req-98af9634-229b-478a-a292-ebf2bb18666c service nova] Creating event network-vif-plugged:7e0a83a8-36d8-4d5c-baf5-d9396dafdb38 for instance 0a2fc94f-e55f-4947-9824-ffc6edf35e0c on hv-cinder-82301 Jan 19 13:09:48.454845 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-88f1b9e9-05db-4dcb-869a-31fa02e91971 req-98af9634-229b-478a-a292-ebf2bb18666c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033596 Jan 19 13:09:48.455455 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 420/832] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:09:49.434199 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b3d6e584-dd36-40b6-b931-e662b8f380ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:49.434785 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b3d6e584-dd36-40b6-b931-e662b8f380ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:49.441329 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b3d6e584-dd36-40b6-b931-e662b8f380ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:49.441783 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b3d6e584-dd36-40b6-b931-e662b8f380ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:49.442563 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b3d6e584-dd36-40b6-b931-e662b8f380ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:49.443025 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b3d6e584-dd36-40b6-b931-e662b8f380ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:49.574900 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b3d6e584-dd36-40b6-b931-e662b8f380ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:49.583009 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b3d6e584-dd36-40b6-b931-e662b8f380ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:49.584547 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b3d6e584-dd36-40b6-b931-e662b8f380ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:49.585698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b3d6e584-dd36-40b6-b931-e662b8f380ae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.155998 Jan 19 13:09:49.586262 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 413/833] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:49 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:09:50.603910 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4ab35db0-99a4-405c-9e11-5ff984fa657d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:50.604780 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4ab35db0-99a4-405c-9e11-5ff984fa657d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:50.611411 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4ab35db0-99a4-405c-9e11-5ff984fa657d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:50.611857 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4ab35db0-99a4-405c-9e11-5ff984fa657d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:50.612656 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4ab35db0-99a4-405c-9e11-5ff984fa657d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:50.613763 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4ab35db0-99a4-405c-9e11-5ff984fa657d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:50.747024 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4ab35db0-99a4-405c-9e11-5ff984fa657d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:50.755730 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4ab35db0-99a4-405c-9e11-5ff984fa657d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:50.757291 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4ab35db0-99a4-405c-9e11-5ff984fa657d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:50.758457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4ab35db0-99a4-405c-9e11-5ff984fa657d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1806 microversion: 2.20 time: 0.158763 Jan 19 13:09:50.759352 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 421/834] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:50 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:09:51.776701 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-18fc8c2a-6c9f-4a98-b05c-dc006e58d90f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:09:51.777306 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-18fc8c2a-6c9f-4a98-b05c-dc006e58d90f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:09:51.783810 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-18fc8c2a-6c9f-4a98-b05c-dc006e58d90f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:51.784306 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-18fc8c2a-6c9f-4a98-b05c-dc006e58d90f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:51.785126 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-18fc8c2a-6c9f-4a98-b05c-dc006e58d90f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:09:51.785563 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-18fc8c2a-6c9f-4a98-b05c-dc006e58d90f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:09:51.914254 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-18fc8c2a-6c9f-4a98-b05c-dc006e58d90f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:51.923210 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-18fc8c2a-6c9f-4a98-b05c-dc006e58d90f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:51.924771 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-18fc8c2a-6c9f-4a98-b05c-dc006e58d90f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:09:51.925939 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-18fc8c2a-6c9f-4a98-b05c-dc006e58d90f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1793 microversion: 2.20 time: 0.152910 Jan 19 13:09:51.926464 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 414/835] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:09:51 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1793 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:10:19.360080 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6d0ecd91-29e0-4f68-9c80-c15e0163e5f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:19.360627 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6d0ecd91-29e0-4f68-9c80-c15e0163e5f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:19.366477 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d0ecd91-29e0-4f68-9c80-c15e0163e5f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:19.366933 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d0ecd91-29e0-4f68-9c80-c15e0163e5f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:19.367942 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d0ecd91-29e0-4f68-9c80-c15e0163e5f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:19.368412 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d0ecd91-29e0-4f68-9c80-c15e0163e5f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:19.444256 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.objects.instance [None req-6d0ecd91-29e0-4f68-9c80-c15e0163e5f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lazy-loading 'services' on Instance uuid e4c0570c-1d8d-41ff-9ec2-9325d1a121ca {{(pid=116361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:10:19.552967 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6d0ecd91-29e0-4f68-9c80-c15e0163e5f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/os-volume_attachments/41d7e0ce-00ad-4048-92cc-1269f4205b92" status: 202 len: 0 microversion: 2.1 time: 0.352704 Jan 19 13:10:19.553569 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 422/836] 10.222.0.48 () {58 vars in 1415 bytes} [Wed Jan 19 13:10:19 2022] DELETE /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/os-volume_attachments/41d7e0ce-00ad-4048-92cc-1269f4205b92 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:10:20.658604 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e637d18c-a0f8-4610-8e31-344ae2de156b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:10:20.665384 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e637d18c-a0f8-4610-8e31-344ae2de156b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:20.665838 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e637d18c-a0f8-4610-8e31-344ae2de156b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:20.729533 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e637d18c-a0f8-4610-8e31-344ae2de156b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Going to try to stop instance {{(pid=116360) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 19 13:10:20.771932 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e637d18c-a0f8-4610-8e31-344ae2de156b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 202 len: 0 microversion: 2.1 time: 0.116797 Jan 19 13:10:20.772955 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 415/837] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:10:20 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:10:20.782482 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-27766471-a33e-4aa2-b362-aa77803d2131 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:20.783391 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-27766471-a33e-4aa2-b362-aa77803d2131 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:20.790677 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27766471-a33e-4aa2-b362-aa77803d2131 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:20.791141 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27766471-a33e-4aa2-b362-aa77803d2131 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:20.792112 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27766471-a33e-4aa2-b362-aa77803d2131 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:20.792548 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27766471-a33e-4aa2-b362-aa77803d2131 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:20.928359 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-27766471-a33e-4aa2-b362-aa77803d2131 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:20.935687 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-27766471-a33e-4aa2-b362-aa77803d2131 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1676 microversion: 2.1 time: 0.157672 Jan 19 13:10:20.936283 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 423/838] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:20 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:21.952985 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b6f77f5d-cede-47b6-a7b3-d1b3df74448f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:21.953617 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b6f77f5d-cede-47b6-a7b3-d1b3df74448f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:21.960463 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b6f77f5d-cede-47b6-a7b3-d1b3df74448f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:21.961554 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b6f77f5d-cede-47b6-a7b3-d1b3df74448f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:21.962387 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b6f77f5d-cede-47b6-a7b3-d1b3df74448f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:21.962828 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b6f77f5d-cede-47b6-a7b3-d1b3df74448f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:22.090656 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b6f77f5d-cede-47b6-a7b3-d1b3df74448f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:22.098296 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b6f77f5d-cede-47b6-a7b3-d1b3df74448f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1676 microversion: 2.1 time: 0.149466 Jan 19 13:10:22.098866 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 416/839] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:21 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:23.120801 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8618aecb-3a45-4565-b759-9cfe6673a279 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:23.121338 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8618aecb-3a45-4565-b759-9cfe6673a279 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:23.127428 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8618aecb-3a45-4565-b759-9cfe6673a279 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:23.127875 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8618aecb-3a45-4565-b759-9cfe6673a279 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:23.128669 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8618aecb-3a45-4565-b759-9cfe6673a279 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:23.129104 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8618aecb-3a45-4565-b759-9cfe6673a279 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:23.261464 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-8618aecb-3a45-4565-b759-9cfe6673a279 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:23.270646 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8618aecb-3a45-4565-b759-9cfe6673a279 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1676 microversion: 2.1 time: 0.154169 Jan 19 13:10:23.271342 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 424/840] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:23 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:24.288074 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2ac2948a-7601-4349-9418-dd40a9c3e5d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:24.288676 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2ac2948a-7601-4349-9418-dd40a9c3e5d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:24.295278 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ac2948a-7601-4349-9418-dd40a9c3e5d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:24.295724 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ac2948a-7601-4349-9418-dd40a9c3e5d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:24.296518 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ac2948a-7601-4349-9418-dd40a9c3e5d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:24.296954 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ac2948a-7601-4349-9418-dd40a9c3e5d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:24.423302 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2ac2948a-7601-4349-9418-dd40a9c3e5d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:24.431165 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2ac2948a-7601-4349-9418-dd40a9c3e5d1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1676 microversion: 2.1 time: 0.146685 Jan 19 13:10:24.431729 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 417/841] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:24 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:25.448309 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-378b2d93-9f89-4645-b92f-59886b8f0dd6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:25.448859 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-378b2d93-9f89-4645-b92f-59886b8f0dd6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:25.455142 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-378b2d93-9f89-4645-b92f-59886b8f0dd6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:25.455623 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-378b2d93-9f89-4645-b92f-59886b8f0dd6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:25.456436 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-378b2d93-9f89-4645-b92f-59886b8f0dd6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:25.456877 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-378b2d93-9f89-4645-b92f-59886b8f0dd6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:25.587290 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-378b2d93-9f89-4645-b92f-59886b8f0dd6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:25.594947 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-378b2d93-9f89-4645-b92f-59886b8f0dd6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1676 microversion: 2.1 time: 0.151168 Jan 19 13:10:25.595514 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 425/842] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:25 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:26.612245 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-58349247-abf4-4d2a-abb0-f41896f3e99d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:26.612799 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-58349247-abf4-4d2a-abb0-f41896f3e99d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:26.619703 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-58349247-abf4-4d2a-abb0-f41896f3e99d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:26.620183 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-58349247-abf4-4d2a-abb0-f41896f3e99d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:26.620953 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-58349247-abf4-4d2a-abb0-f41896f3e99d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:26.621385 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-58349247-abf4-4d2a-abb0-f41896f3e99d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:26.749922 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-58349247-abf4-4d2a-abb0-f41896f3e99d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:26.757290 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-58349247-abf4-4d2a-abb0-f41896f3e99d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1676 microversion: 2.1 time: 0.148622 Jan 19 13:10:26.758124 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 418/843] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:26 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:27.776227 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d7354b1d-f092-4475-afe1-3326f9476100 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:27.776831 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d7354b1d-f092-4475-afe1-3326f9476100 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:27.783059 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d7354b1d-f092-4475-afe1-3326f9476100 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:27.783515 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d7354b1d-f092-4475-afe1-3326f9476100 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:27.784328 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d7354b1d-f092-4475-afe1-3326f9476100 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:27.784775 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d7354b1d-f092-4475-afe1-3326f9476100 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:27.918356 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d7354b1d-f092-4475-afe1-3326f9476100 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:27.925646 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d7354b1d-f092-4475-afe1-3326f9476100 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1676 microversion: 2.1 time: 0.154106 Jan 19 13:10:27.926222 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 426/844] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:27 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:28.942479 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-56d71bb5-46b9-419e-a7e5-872e1f1f84a4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:28.943084 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-56d71bb5-46b9-419e-a7e5-872e1f1f84a4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:28.949969 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-56d71bb5-46b9-419e-a7e5-872e1f1f84a4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:28.950422 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-56d71bb5-46b9-419e-a7e5-872e1f1f84a4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:28.951204 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-56d71bb5-46b9-419e-a7e5-872e1f1f84a4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:28.951643 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-56d71bb5-46b9-419e-a7e5-872e1f1f84a4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:29.090864 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-56d71bb5-46b9-419e-a7e5-872e1f1f84a4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:29.098232 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-56d71bb5-46b9-419e-a7e5-872e1f1f84a4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1676 microversion: 2.1 time: 0.159357 Jan 19 13:10:29.098794 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 419/845] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:28 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:29.356415 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a5b02f96-f813-4403-aca0-2496cebed2f1 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:10:29.357432 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a5b02f96-f813-4403-aca0-2496cebed2f1 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:29.363842 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a5b02f96-f813-4403-aca0-2496cebed2f1 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:29.364327 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a5b02f96-f813-4403-aca0-2496cebed2f1 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:29.365110 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a5b02f96-f813-4403-aca0-2496cebed2f1 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:29.365568 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a5b02f96-f813-4403-aca0-2496cebed2f1 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:29.437536 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a5b02f96-f813-4403-aca0-2496cebed2f1 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "POST /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/action" status: 202 len: 0 microversion: 2.1 time: 0.085088 Jan 19 13:10:29.438355 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 427/846] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:10:29 2022] POST /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:10:29.447334 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d08ce695-b5b7-4fa5-9ae7-f946516566eb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:29.448185 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d08ce695-b5b7-4fa5-9ae7-f946516566eb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:29.454274 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d08ce695-b5b7-4fa5-9ae7-f946516566eb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:29.454830 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d08ce695-b5b7-4fa5-9ae7-f946516566eb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:29.456022 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d08ce695-b5b7-4fa5-9ae7-f946516566eb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:29.456470 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d08ce695-b5b7-4fa5-9ae7-f946516566eb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:29.692789 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d08ce695-b5b7-4fa5-9ae7-f946516566eb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:29.700756 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d08ce695-b5b7-4fa5-9ae7-f946516566eb tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1751 microversion: 2.1 time: 0.257468 Jan 19 13:10:29.701582 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 420/847] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:29 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1751 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:30.115580 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5484ca1a-336c-4c05-8ea5-cb929c7c0dda tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:30.116319 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5484ca1a-336c-4c05-8ea5-cb929c7c0dda tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:30.122453 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5484ca1a-336c-4c05-8ea5-cb929c7c0dda tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:30.122904 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5484ca1a-336c-4c05-8ea5-cb929c7c0dda tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:30.123681 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5484ca1a-336c-4c05-8ea5-cb929c7c0dda tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:30.124161 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5484ca1a-336c-4c05-8ea5-cb929c7c0dda tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:30.261042 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5484ca1a-336c-4c05-8ea5-cb929c7c0dda tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:30.269056 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5484ca1a-336c-4c05-8ea5-cb929c7c0dda tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1676 microversion: 2.1 time: 0.157590 Jan 19 13:10:30.269616 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 428/848] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:30 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:30.719141 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-dbac89ab-302d-44e2-8f2b-b06f903734ef tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:30.719773 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-dbac89ab-302d-44e2-8f2b-b06f903734ef tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:30.726003 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dbac89ab-302d-44e2-8f2b-b06f903734ef tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:30.726453 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dbac89ab-302d-44e2-8f2b-b06f903734ef tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:30.727231 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dbac89ab-302d-44e2-8f2b-b06f903734ef tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:30.727664 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dbac89ab-302d-44e2-8f2b-b06f903734ef tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:31.017559 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-dbac89ab-302d-44e2-8f2b-b06f903734ef tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:31.025516 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-dbac89ab-302d-44e2-8f2b-b06f903734ef tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1756 microversion: 2.1 time: 0.309957 Jan 19 13:10:31.026075 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 421/849] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:30 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1756 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:31.285965 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-eec274b4-3d12-4993-addf-dfe37a149198 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:31.286503 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-eec274b4-3d12-4993-addf-dfe37a149198 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:31.293375 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eec274b4-3d12-4993-addf-dfe37a149198 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:31.293830 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eec274b4-3d12-4993-addf-dfe37a149198 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:31.294647 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eec274b4-3d12-4993-addf-dfe37a149198 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:31.295088 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eec274b4-3d12-4993-addf-dfe37a149198 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:31.424679 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-eec274b4-3d12-4993-addf-dfe37a149198 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:31.431915 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-eec274b4-3d12-4993-addf-dfe37a149198 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1653 microversion: 2.1 time: 0.149702 Jan 19 13:10:31.432504 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 429/850] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:31 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1653 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:31.448010 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-593a8713-fe9d-43fa-84c2-2eba868b8a99 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:10:31.453758 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-593a8713-fe9d-43fa-84c2-2eba868b8a99 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:31.454207 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-593a8713-fe9d-43fa-84c2-2eba868b8a99 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:31.476380 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-593a8713-fe9d-43fa-84c2-2eba868b8a99 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Going to try to start instance {{(pid=116360) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 19 13:10:31.517194 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-593a8713-fe9d-43fa-84c2-2eba868b8a99 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action" status: 202 len: 0 microversion: 2.1 time: 0.072917 Jan 19 13:10:31.517769 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 422/851] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:10:31 2022] POST /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:10:31.526578 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9b552a88-ada0-4950-a56f-8dfc7d8a3c64 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:31.527200 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9b552a88-ada0-4950-a56f-8dfc7d8a3c64 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:31.533282 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9b552a88-ada0-4950-a56f-8dfc7d8a3c64 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:31.533821 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9b552a88-ada0-4950-a56f-8dfc7d8a3c64 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:31.534761 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9b552a88-ada0-4950-a56f-8dfc7d8a3c64 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:31.535319 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9b552a88-ada0-4950-a56f-8dfc7d8a3c64 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:31.721929 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-9b552a88-ada0-4950-a56f-8dfc7d8a3c64 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:31.729250 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9b552a88-ada0-4950-a56f-8dfc7d8a3c64 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1662 microversion: 2.1 time: 0.206993 Jan 19 13:10:31.729809 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 430/852] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:31 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1662 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:10:32.043061 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ef263ab2-79a6-48bc-a121-0959945e025a tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:32.043780 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ef263ab2-79a6-48bc-a121-0959945e025a tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:32.050240 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ef263ab2-79a6-48bc-a121-0959945e025a tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:32.050685 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ef263ab2-79a6-48bc-a121-0959945e025a tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:32.051482 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ef263ab2-79a6-48bc-a121-0959945e025a tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:32.051914 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ef263ab2-79a6-48bc-a121-0959945e025a tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:32.219167 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ef263ab2-79a6-48bc-a121-0959945e025a tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:32.227125 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ef263ab2-79a6-48bc-a121-0959945e025a tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1756 microversion: 2.1 time: 0.188190 Jan 19 13:10:32.227676 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 423/853] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:32 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:32.745946 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-eb7ab102-764f-4464-a2e6-5d00874d24ae tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:32.746540 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-eb7ab102-764f-4464-a2e6-5d00874d24ae tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:32.752619 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb7ab102-764f-4464-a2e6-5d00874d24ae tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:32.753062 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb7ab102-764f-4464-a2e6-5d00874d24ae tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:32.753823 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb7ab102-764f-4464-a2e6-5d00874d24ae tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:32.754251 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-eb7ab102-764f-4464-a2e6-5d00874d24ae tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:32.884780 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-eb7ab102-764f-4464-a2e6-5d00874d24ae tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:32.892120 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-eb7ab102-764f-4464-a2e6-5d00874d24ae tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1666 microversion: 2.1 time: 0.149800 Jan 19 13:10:32.892681 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 431/854] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:32 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:33.243425 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-dc3ebe2c-6bd6-4795-b96d-da374e8e2b9c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:33.244149 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-dc3ebe2c-6bd6-4795-b96d-da374e8e2b9c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:33.250375 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dc3ebe2c-6bd6-4795-b96d-da374e8e2b9c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:33.250830 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dc3ebe2c-6bd6-4795-b96d-da374e8e2b9c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:33.251617 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dc3ebe2c-6bd6-4795-b96d-da374e8e2b9c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:33.252085 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dc3ebe2c-6bd6-4795-b96d-da374e8e2b9c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:33.393473 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-dc3ebe2c-6bd6-4795-b96d-da374e8e2b9c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:33.401875 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-dc3ebe2c-6bd6-4795-b96d-da374e8e2b9c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1756 microversion: 2.1 time: 0.162125 Jan 19 13:10:33.402800 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 424/855] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:33 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:34.419022 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-80426851-2027-49b2-aef7-3c4b3ce6d821 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:34.419666 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-80426851-2027-49b2-aef7-3c4b3ce6d821 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:34.425967 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-80426851-2027-49b2-aef7-3c4b3ce6d821 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:34.426422 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-80426851-2027-49b2-aef7-3c4b3ce6d821 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:34.427200 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-80426851-2027-49b2-aef7-3c4b3ce6d821 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:34.427647 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-80426851-2027-49b2-aef7-3c4b3ce6d821 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:34.569651 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-80426851-2027-49b2-aef7-3c4b3ce6d821 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:34.577899 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-80426851-2027-49b2-aef7-3c4b3ce6d821 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1756 microversion: 2.1 time: 0.163061 Jan 19 13:10:34.578465 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 432/856] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:34 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:35.595646 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5b20de28-a211-40d8-84c2-a0cd8c1cb3aa tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:35.596289 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5b20de28-a211-40d8-84c2-a0cd8c1cb3aa tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:35.602521 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5b20de28-a211-40d8-84c2-a0cd8c1cb3aa tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:35.602983 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5b20de28-a211-40d8-84c2-a0cd8c1cb3aa tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:35.603810 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5b20de28-a211-40d8-84c2-a0cd8c1cb3aa tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:35.604277 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5b20de28-a211-40d8-84c2-a0cd8c1cb3aa tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:35.749074 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5b20de28-a211-40d8-84c2-a0cd8c1cb3aa tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:35.756953 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5b20de28-a211-40d8-84c2-a0cd8c1cb3aa tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1756 microversion: 2.1 time: 0.164991 Jan 19 13:10:35.757518 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 425/857] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:35 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:36.775627 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1a4e3829-b62e-4912-b0ab-3f7f32c1fd66 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:36.776272 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1a4e3829-b62e-4912-b0ab-3f7f32c1fd66 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:36.782517 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1a4e3829-b62e-4912-b0ab-3f7f32c1fd66 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:36.782969 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1a4e3829-b62e-4912-b0ab-3f7f32c1fd66 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:36.783743 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1a4e3829-b62e-4912-b0ab-3f7f32c1fd66 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:36.784219 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1a4e3829-b62e-4912-b0ab-3f7f32c1fd66 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:36.926767 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-1a4e3829-b62e-4912-b0ab-3f7f32c1fd66 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:36.934813 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1a4e3829-b62e-4912-b0ab-3f7f32c1fd66 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1756 microversion: 2.1 time: 0.163497 Jan 19 13:10:36.935379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 433/858] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:36 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:37.951566 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b9d03825-d64e-455b-9a5e-5f82d91041c7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:37.952207 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b9d03825-d64e-455b-9a5e-5f82d91041c7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:37.958490 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b9d03825-d64e-455b-9a5e-5f82d91041c7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:37.958945 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b9d03825-d64e-455b-9a5e-5f82d91041c7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:37.959724 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b9d03825-d64e-455b-9a5e-5f82d91041c7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:37.960198 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b9d03825-d64e-455b-9a5e-5f82d91041c7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:38.105607 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b9d03825-d64e-455b-9a5e-5f82d91041c7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:38.114148 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b9d03825-d64e-455b-9a5e-5f82d91041c7 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1756 microversion: 2.1 time: 0.166268 Jan 19 13:10:38.114756 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 426/859] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:37 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:39.130892 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0aa6f13b-4ba0-4117-b70c-f835e3f1f34e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:39.131459 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0aa6f13b-4ba0-4117-b70c-f835e3f1f34e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:39.137861 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0aa6f13b-4ba0-4117-b70c-f835e3f1f34e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:39.138318 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0aa6f13b-4ba0-4117-b70c-f835e3f1f34e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:39.139107 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0aa6f13b-4ba0-4117-b70c-f835e3f1f34e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:39.139545 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0aa6f13b-4ba0-4117-b70c-f835e3f1f34e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:39.278114 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0aa6f13b-4ba0-4117-b70c-f835e3f1f34e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:39.286222 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0aa6f13b-4ba0-4117-b70c-f835e3f1f34e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1756 microversion: 2.1 time: 0.159087 Jan 19 13:10:39.286795 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 434/860] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:39 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:10:40.302443 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6ee7abcd-e279-4dd0-9729-8ab6ea13f846 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:40.303043 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6ee7abcd-e279-4dd0-9729-8ab6ea13f846 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:40.309840 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ee7abcd-e279-4dd0-9729-8ab6ea13f846 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:40.310311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ee7abcd-e279-4dd0-9729-8ab6ea13f846 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:40.311076 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ee7abcd-e279-4dd0-9729-8ab6ea13f846 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:40.311507 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ee7abcd-e279-4dd0-9729-8ab6ea13f846 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:40.457254 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6ee7abcd-e279-4dd0-9729-8ab6ea13f846 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:40.465259 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6ee7abcd-e279-4dd0-9729-8ab6ea13f846 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1756 microversion: 2.1 time: 0.166471 Jan 19 13:10:40.465823 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 427/861] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:40 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:41.482476 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-fc47836a-a97a-4c43-b2c3-bf055a0f1ba3 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:41.483082 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-fc47836a-a97a-4c43-b2c3-bf055a0f1ba3 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:41.489389 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fc47836a-a97a-4c43-b2c3-bf055a0f1ba3 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:41.489838 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fc47836a-a97a-4c43-b2c3-bf055a0f1ba3 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:41.490615 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fc47836a-a97a-4c43-b2c3-bf055a0f1ba3 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:41.491049 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fc47836a-a97a-4c43-b2c3-bf055a0f1ba3 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:41.641486 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-fc47836a-a97a-4c43-b2c3-bf055a0f1ba3 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:41.649932 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-fc47836a-a97a-4c43-b2c3-bf055a0f1ba3 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1759 microversion: 2.1 time: 0.170531 Jan 19 13:10:41.650553 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 435/862] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:10:41 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:47.369700 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-20f3a9ef-6aec-487a-86a1-deda285d19cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:47.370250 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-20f3a9ef-6aec-487a-86a1-deda285d19cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:47.376192 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-20f3a9ef-6aec-487a-86a1-deda285d19cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:47.376645 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-20f3a9ef-6aec-487a-86a1-deda285d19cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:47.377414 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-20f3a9ef-6aec-487a-86a1-deda285d19cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:47.377846 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-20f3a9ef-6aec-487a-86a1-deda285d19cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:47.406892 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-20f3a9ef-6aec-487a-86a1-deda285d19cd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/os-volume_attachments/cc2ab7c6-19ba-41bc-a4a3-32c6f7638c46" status: 200 len: 194 microversion: 2.20 time: 0.042089 Jan 19 13:10:47.407449 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 428/863] 10.222.0.48 () {60 vars in 1453 bytes} [Wed Jan 19 13:10:47 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/os-volume_attachments/cc2ab7c6-19ba-41bc-a4a3-32c6f7638c46 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:10:47.468013 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9fa55818-bf90-4150-a5fe-470608f316ba tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:47.468511 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9fa55818-bf90-4150-a5fe-470608f316ba tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:47.474715 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9fa55818-bf90-4150-a5fe-470608f316ba tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:47.475165 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9fa55818-bf90-4150-a5fe-470608f316ba tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:47.475940 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9fa55818-bf90-4150-a5fe-470608f316ba tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:47.476404 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9fa55818-bf90-4150-a5fe-470608f316ba tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:47.554276 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.objects.instance [None req-9fa55818-bf90-4150-a5fe-470608f316ba tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lazy-loading 'services' on Instance uuid 0a2fc94f-e55f-4947-9824-ffc6edf35e0c {{(pid=116361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:10:47.623640 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9fa55818-bf90-4150-a5fe-470608f316ba tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/os-volume_attachments/cc2ab7c6-19ba-41bc-a4a3-32c6f7638c46" status: 202 len: 0 microversion: 2.20 time: 0.159068 Jan 19 13:10:47.624354 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 436/864] 10.222.0.48 () {60 vars in 1456 bytes} [Wed Jan 19 13:10:47 2022] DELETE /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/os-volume_attachments/cc2ab7c6-19ba-41bc-a4a3-32c6f7638c46 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:10:47.632293 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3779d18a-aec2-49f9-971b-53f3aca9caba tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:47.633256 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3779d18a-aec2-49f9-971b-53f3aca9caba tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:47.639432 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3779d18a-aec2-49f9-971b-53f3aca9caba tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:47.639877 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3779d18a-aec2-49f9-971b-53f3aca9caba tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:47.640677 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3779d18a-aec2-49f9-971b-53f3aca9caba tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:47.641112 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3779d18a-aec2-49f9-971b-53f3aca9caba tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:47.674625 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3779d18a-aec2-49f9-971b-53f3aca9caba tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045515 Jan 19 13:10:47.679373 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 429/865] 10.222.0.48 () {60 vars in 1342 bytes} [Wed Jan 19 13:10:47 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:10:48.688180 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-05ab35d3-813f-47b2-a33f-061bc6edeffc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:48.689164 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-05ab35d3-813f-47b2-a33f-061bc6edeffc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:48.695284 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05ab35d3-813f-47b2-a33f-061bc6edeffc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:48.695728 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05ab35d3-813f-47b2-a33f-061bc6edeffc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:48.697267 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05ab35d3-813f-47b2-a33f-061bc6edeffc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:48.697706 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05ab35d3-813f-47b2-a33f-061bc6edeffc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:48.725152 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-05ab35d3-813f-47b2-a33f-061bc6edeffc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041685 Jan 19 13:10:48.725708 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 437/866] 10.222.0.48 () {60 vars in 1342 bytes} [Wed Jan 19 13:10:48 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:10:48.781276 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-cac1ae06-f7d4-4f75-874a-cfeec7c7e1ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:48.781806 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-cac1ae06-f7d4-4f75-874a-cfeec7c7e1ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:48.788099 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cac1ae06-f7d4-4f75-874a-cfeec7c7e1ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:48.788552 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cac1ae06-f7d4-4f75-874a-cfeec7c7e1ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:48.789317 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cac1ae06-f7d4-4f75-874a-cfeec7c7e1ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:48.790260 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cac1ae06-f7d4-4f75-874a-cfeec7c7e1ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:48.814466 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-cac1ae06-f7d4-4f75-874a-cfeec7c7e1ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Going to try to terminate instance {{(pid=116360) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:10:48.889808 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-cac1ae06-f7d4-4f75-874a-cfeec7c7e1ed tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 204 len: 0 microversion: 2.20 time: 0.111871 Jan 19 13:10:48.890429 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 430/867] 10.222.0.48 () {60 vars in 1279 bytes} [Wed Jan 19 13:10:48 2022] DELETE /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 19 13:10:48.898501 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d0052ea7-f039-4f6c-82d0-66547cde2a2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:48.899145 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d0052ea7-f039-4f6c-82d0-66547cde2a2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:48.905060 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d0052ea7-f039-4f6c-82d0-66547cde2a2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:48.905512 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d0052ea7-f039-4f6c-82d0-66547cde2a2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:48.906287 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d0052ea7-f039-4f6c-82d0-66547cde2a2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:48.906723 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d0052ea7-f039-4f6c-82d0-66547cde2a2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:49.034065 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d0052ea7-f039-4f6c-82d0-66547cde2a2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:49.042035 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d0052ea7-f039-4f6c-82d0-66547cde2a2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:49.043538 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d0052ea7-f039-4f6c-82d0-66547cde2a2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:49.044726 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d0052ea7-f039-4f6c-82d0-66547cde2a2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1721 microversion: 2.20 time: 0.149896 Jan 19 13:10:49.045290 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 438/868] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:10:48 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:10:50.063398 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7fb95b7d-2145-49e9-a42e-ca1e8af5b42d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:50.064114 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7fb95b7d-2145-49e9-a42e-ca1e8af5b42d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:50.070274 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fb95b7d-2145-49e9-a42e-ca1e8af5b42d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:50.070753 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fb95b7d-2145-49e9-a42e-ca1e8af5b42d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:50.071509 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fb95b7d-2145-49e9-a42e-ca1e8af5b42d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:50.071941 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fb95b7d-2145-49e9-a42e-ca1e8af5b42d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:50.203327 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7fb95b7d-2145-49e9-a42e-ca1e8af5b42d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:50.211013 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7fb95b7d-2145-49e9-a42e-ca1e8af5b42d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:50.213134 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7fb95b7d-2145-49e9-a42e-ca1e8af5b42d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:50.214278 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7fb95b7d-2145-49e9-a42e-ca1e8af5b42d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1721 microversion: 2.20 time: 0.154987 Jan 19 13:10:50.214822 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 431/869] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:10:50 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:10:51.232936 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-99ed7c0b-672b-43f4-8a5d-2446185c34ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:51.233538 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-99ed7c0b-672b-43f4-8a5d-2446185c34ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:51.239885 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-99ed7c0b-672b-43f4-8a5d-2446185c34ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:51.240370 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-99ed7c0b-672b-43f4-8a5d-2446185c34ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:51.241145 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-99ed7c0b-672b-43f4-8a5d-2446185c34ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:51.241572 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-99ed7c0b-672b-43f4-8a5d-2446185c34ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:51.329494 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-99ed7c0b-672b-43f4-8a5d-2446185c34ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:51.337606 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-99ed7c0b-672b-43f4-8a5d-2446185c34ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:51.339048 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-99ed7c0b-672b-43f4-8a5d-2446185c34ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:51.340218 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-99ed7c0b-672b-43f4-8a5d-2446185c34ac tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 200 len: 1654 microversion: 2.20 time: 0.111121 Jan 19 13:10:51.340778 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 439/870] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:10:51 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 1654 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:10:51.624302 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-fdb46b27-cdd9-4615-b309-1116d99de9d1 req-f91755cd-d27c-400f-9580-ce4cc6b7d2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2fc94f-e55f-4947-9824-ffc6edf35e0c", "name": "network-vif-deleted", "tag": "7e0a83a8-36d8-4d5c-baf5-d9396dafdb38"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:10:51.626910 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:10:51.626910 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:10:51.635742 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-fdb46b27-cdd9-4615-b309-1116d99de9d1 req-f91755cd-d27c-400f-9580-ce4cc6b7d2c2 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:51.636277 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-fdb46b27-cdd9-4615-b309-1116d99de9d1 req-f91755cd-d27c-400f-9580-ce4cc6b7d2c2 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:51.652349 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-fdb46b27-cdd9-4615-b309-1116d99de9d1 req-f91755cd-d27c-400f-9580-ce4cc6b7d2c2 service nova] Creating event network-vif-deleted:7e0a83a8-36d8-4d5c-baf5-d9396dafdb38 for instance 0a2fc94f-e55f-4947-9824-ffc6edf35e0c on hv-cinder-82301 Jan 19 13:10:51.657665 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-fdb46b27-cdd9-4615-b309-1116d99de9d1 req-f91755cd-d27c-400f-9580-ce4cc6b7d2c2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109833 Jan 19 13:10:51.658373 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 432/871] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:10:52.357903 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-67913514-8185-4388-9fe8-87ebd89d57fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:52.358598 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-67913514-8185-4388-9fe8-87ebd89d57fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:52.365233 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-67913514-8185-4388-9fe8-87ebd89d57fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:52.365749 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-67913514-8185-4388-9fe8-87ebd89d57fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:52.366720 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-67913514-8185-4388-9fe8-87ebd89d57fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:52.367176 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-67913514-8185-4388-9fe8-87ebd89d57fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:52.385500 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-67913514-8185-4388-9fe8-87ebd89d57fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] HTTP exception thrown: Instance 0a2fc94f-e55f-4947-9824-ffc6edf35e0c could not be found. Jan 19 13:10:52.386113 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-67913514-8185-4388-9fe8-87ebd89d57fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Returning 404 to user: Instance 0a2fc94f-e55f-4947-9824-ffc6edf35e0c could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:10:52.386948 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-67913514-8185-4388-9fe8-87ebd89d57fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 404 len: 111 microversion: 2.20 time: 0.033091 Jan 19 13:10:52.387893 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 440/872] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:10:52 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 13:10:52.396406 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-8744605c-af10-4de9-87d0-56234f472782 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '.version_select at 0x7f07e44aa8b0>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:52.422931 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-8744605c-af10-4de9-87d0-56234f472782 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470167233" status: 204 len: 0 microversion: 2.20 time: 0.030664 Jan 19 13:10:52.424003 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 433/873] 10.222.0.48 () {60 vars in 1261 bytes} [Wed Jan 19 13:10:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470167233 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 19 13:10:53.342588 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-db247b1c-320b-417b-a566-fc8d3671073a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'create', calling method: .version_select at 0x7f07d7bb7ee0>, body: {"keypair": {"name": "tempest-keypair-1807079078"}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:10:53.356829 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-db247b1c-320b-417b-a566-fc8d3671073a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Getting quotas for project efc6dbc546054e459498f200e327e75e. Resources: {'key_pairs'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:10:53.360687 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-db247b1c-320b-417b-a566-fc8d3671073a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Getting quotas for user 10527eff7ddc473396e1ce848c39c7e9 and project efc6dbc546054e459498f200e327e75e. Resources: {'key_pairs'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:10:53.373020 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: ERROR oslo.messaging._drivers.impl_rabbit [None req-db247b1c-320b-417b-a566-fc8d3671073a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [77035f2b-983e-45ca-abc5-5576e804debf] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 19 13:10:54.382442 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO oslo.messaging._drivers.impl_rabbit [None req-db247b1c-320b-417b-a566-fc8d3671073a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [77035f2b-983e-45ca-abc5-5576e804debf] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 52906. Jan 19 13:10:54.964460 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-db247b1c-320b-417b-a566-fc8d3671073a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Getting quotas for project efc6dbc546054e459498f200e327e75e. Resources: {'key_pairs'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:10:54.968049 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-db247b1c-320b-417b-a566-fc8d3671073a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Getting quotas for user 10527eff7ddc473396e1ce848c39c7e9 and project efc6dbc546054e459498f200e327e75e. Resources: {'key_pairs'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:10:54.981064 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-db247b1c-320b-417b-a566-fc8d3671073a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.642270 Jan 19 13:10:54.981643 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 441/874] 10.222.0.48 () {62 vars in 1198 bytes} [Wed Jan 19 13:10:53 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1643 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 19 13:10:56.240556 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1527110937", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c97970eb-1cd7-4b38-8fa2-dc9eda10cae4"}], "security_groups": [{"name": "tempest-securitygroup--37519455"}], "key_name": "tempest-keypair-1807079078", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:10:56.343190 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.network.neutron [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] validate_networks() for [('c97970eb-1cd7-4b38-8fa2-dc9eda10cae4', None, None, None, None, None)] {{(pid=116360) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:10:56.745167 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Flavor limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:10:56.745592 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Image limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:10:56.746074 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Flavor pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:10:56.746484 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Image pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:10:56.746938 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:10:56.755431 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:56.755884 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:56.756730 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:56.757172 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:56.773959 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Getting quotas for project efc6dbc546054e459498f200e327e75e. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:10:56.777913 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Getting quotas for user 10527eff7ddc473396e1ce848c39c7e9 and project efc6dbc546054e459498f200e327e75e. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:10:56.788362 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Going to run 1 instances... {{(pid=116360) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:10:56.790894 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:10:56.837746 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2ac7e0c2-0ffb-447c-b970-d6c63e2d059c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.602069 Jan 19 13:10:56.838393 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 434/875] 10.222.0.48 () {62 vars in 1187 bytes} [Wed Jan 19 13:10:56 2022] POST /compute/v2.1/servers => generated 400 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 19 13:10:56.848642 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e82b717e-1148-4a1a-a593-28815de88425 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:56.849257 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e82b717e-1148-4a1a-a593-28815de88425 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:56.902156 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e82b717e-1148-4a1a-a593-28815de88425 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:56.909155 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e82b717e-1148-4a1a-a593-28815de88425 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:56.910658 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e82b717e-1148-4a1a-a593-28815de88425 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:56.911741 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e82b717e-1148-4a1a-a593-28815de88425 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1282 microversion: 2.20 time: 0.067307 Jan 19 13:10:56.912327 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 442/876] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:10:56 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1282 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:10:57.930254 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-283f6ac6-dfeb-4a9b-bd82-245b9965119c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:57.930860 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-283f6ac6-dfeb-4a9b-bd82-245b9965119c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:57.938017 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-283f6ac6-dfeb-4a9b-bd82-245b9965119c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:57.938470 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-283f6ac6-dfeb-4a9b-bd82-245b9965119c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:57.939316 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-283f6ac6-dfeb-4a9b-bd82-245b9965119c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:57.939780 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-283f6ac6-dfeb-4a9b-bd82-245b9965119c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:58.012740 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-283f6ac6-dfeb-4a9b-bd82-245b9965119c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:58.020690 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-283f6ac6-dfeb-4a9b-bd82-245b9965119c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:58.022164 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-283f6ac6-dfeb-4a9b-bd82-245b9965119c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:58.023238 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-283f6ac6-dfeb-4a9b-bd82-245b9965119c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1340 microversion: 2.20 time: 0.097368 Jan 19 13:10:58.024079 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 435/877] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:10:57 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1340 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:10:59.043174 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f9d94361-37a9-4539-85ea-69468605acdd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:10:59.043887 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f9d94361-37a9-4539-85ea-69468605acdd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:10:59.050417 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f9d94361-37a9-4539-85ea-69468605acdd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:59.051221 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f9d94361-37a9-4539-85ea-69468605acdd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:59.052183 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f9d94361-37a9-4539-85ea-69468605acdd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:59.052840 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f9d94361-37a9-4539-85ea-69468605acdd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:59.220737 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-89a17156-6297-442f-9934-99fdd10d476c req-e229c564-1035-4ab8-84e6-c1d5dec00939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d2bd3e-47a3-4158-892e-627b3f1c1095", "tag": "e6862281-58ef-4013-962c-3a0024140b3a"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:10:59.222686 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:10:59.222686 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:10:59.243091 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-89a17156-6297-442f-9934-99fdd10d476c req-e229c564-1035-4ab8-84e6-c1d5dec00939 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:10:59.243965 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-89a17156-6297-442f-9934-99fdd10d476c req-e229c564-1035-4ab8-84e6-c1d5dec00939 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:10:59.259200 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-89a17156-6297-442f-9934-99fdd10d476c req-e229c564-1035-4ab8-84e6-c1d5dec00939 service nova] Creating event network-changed:e6862281-58ef-4013-962c-3a0024140b3a for instance 16d2bd3e-47a3-4158-892e-627b3f1c1095 on hv-cinder-82301 Jan 19 13:10:59.269984 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-89a17156-6297-442f-9934-99fdd10d476c req-e229c564-1035-4ab8-84e6-c1d5dec00939 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055079 Jan 19 13:10:59.271020 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 436/878] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:10:59.295915 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f9d94361-37a9-4539-85ea-69468605acdd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:59.304347 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f9d94361-37a9-4539-85ea-69468605acdd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:59.306786 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f9d94361-37a9-4539-85ea-69468605acdd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:10:59.308091 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f9d94361-37a9-4539-85ea-69468605acdd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1406 microversion: 2.20 time: 0.269607 Jan 19 13:10:59.308724 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 443/879] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:10:59 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:10:59.543484 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:10:59.543658 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: Wed Jan 19 13:10:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:11:00.327604 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c1ad06b6-a622-4de0-936d-40e5388d327b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:00.328254 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c1ad06b6-a622-4de0-936d-40e5388d327b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:00.334330 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c1ad06b6-a622-4de0-936d-40e5388d327b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:00.334789 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c1ad06b6-a622-4de0-936d-40e5388d327b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:00.335565 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c1ad06b6-a622-4de0-936d-40e5388d327b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:00.336068 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c1ad06b6-a622-4de0-936d-40e5388d327b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:00.463327 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c1ad06b6-a622-4de0-936d-40e5388d327b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:00.471016 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c1ad06b6-a622-4de0-936d-40e5388d327b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:00.472584 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c1ad06b6-a622-4de0-936d-40e5388d327b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:00.473686 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c1ad06b6-a622-4de0-936d-40e5388d327b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1406 microversion: 2.20 time: 0.150671 Jan 19 13:11:00.474237 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 437/880] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:11:00 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:11:01.491458 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6f0377ef-4af9-4a7a-89aa-8dd14d56f1a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:01.492089 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6f0377ef-4af9-4a7a-89aa-8dd14d56f1a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:01.498948 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f0377ef-4af9-4a7a-89aa-8dd14d56f1a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:01.499392 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f0377ef-4af9-4a7a-89aa-8dd14d56f1a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:01.500198 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f0377ef-4af9-4a7a-89aa-8dd14d56f1a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:01.500636 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f0377ef-4af9-4a7a-89aa-8dd14d56f1a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:01.635508 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6f0377ef-4af9-4a7a-89aa-8dd14d56f1a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:01.643264 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6f0377ef-4af9-4a7a-89aa-8dd14d56f1a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:01.644810 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6f0377ef-4af9-4a7a-89aa-8dd14d56f1a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:01.645909 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6f0377ef-4af9-4a7a-89aa-8dd14d56f1a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1406 microversion: 2.20 time: 0.158200 Jan 19 13:11:01.646471 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 444/881] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:11:01 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:11:02.663891 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-44788437-e082-4dbe-acff-f4ef28d2c9c0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:02.665701 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-44788437-e082-4dbe-acff-f4ef28d2c9c0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:02.671992 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-44788437-e082-4dbe-acff-f4ef28d2c9c0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:02.672492 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-44788437-e082-4dbe-acff-f4ef28d2c9c0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:02.673263 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-44788437-e082-4dbe-acff-f4ef28d2c9c0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:02.673703 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-44788437-e082-4dbe-acff-f4ef28d2c9c0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:02.805471 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-44788437-e082-4dbe-acff-f4ef28d2c9c0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:02.813163 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-44788437-e082-4dbe-acff-f4ef28d2c9c0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:02.814674 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-44788437-e082-4dbe-acff-f4ef28d2c9c0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:02.815768 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-44788437-e082-4dbe-acff-f4ef28d2c9c0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1406 microversion: 2.20 time: 0.155605 Jan 19 13:11:02.816355 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 438/882] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:11:02 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:11:03.834001 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ef81024d-05bb-4e20-b27a-d21625e3edd3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:03.834609 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ef81024d-05bb-4e20-b27a-d21625e3edd3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:03.841500 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ef81024d-05bb-4e20-b27a-d21625e3edd3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:03.841961 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ef81024d-05bb-4e20-b27a-d21625e3edd3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:03.842744 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ef81024d-05bb-4e20-b27a-d21625e3edd3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:03.843187 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ef81024d-05bb-4e20-b27a-d21625e3edd3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:03.972500 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ef81024d-05bb-4e20-b27a-d21625e3edd3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:03.980357 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ef81024d-05bb-4e20-b27a-d21625e3edd3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:03.981877 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ef81024d-05bb-4e20-b27a-d21625e3edd3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:03.982988 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ef81024d-05bb-4e20-b27a-d21625e3edd3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1406 microversion: 2.20 time: 0.152804 Jan 19 13:11:03.983546 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 445/883] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:11:03 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:11:05.000742 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2fba48f3-fb7a-4a72-b952-022910b41d3f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:05.001375 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2fba48f3-fb7a-4a72-b952-022910b41d3f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:05.008293 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2fba48f3-fb7a-4a72-b952-022910b41d3f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:05.009374 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2fba48f3-fb7a-4a72-b952-022910b41d3f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:05.010156 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2fba48f3-fb7a-4a72-b952-022910b41d3f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:05.010598 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2fba48f3-fb7a-4a72-b952-022910b41d3f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:05.144708 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2fba48f3-fb7a-4a72-b952-022910b41d3f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:05.153147 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2fba48f3-fb7a-4a72-b952-022910b41d3f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:05.154632 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2fba48f3-fb7a-4a72-b952-022910b41d3f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:05.155752 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2fba48f3-fb7a-4a72-b952-022910b41d3f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1406 microversion: 2.20 time: 0.158772 Jan 19 13:11:05.156344 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 439/884] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:11:04 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:11:06.173012 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-45bd0a13-4eee-40ef-b1d5-4089e8e944d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:06.173528 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-45bd0a13-4eee-40ef-b1d5-4089e8e944d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:06.180636 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-45bd0a13-4eee-40ef-b1d5-4089e8e944d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:06.181087 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-45bd0a13-4eee-40ef-b1d5-4089e8e944d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:06.181904 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-45bd0a13-4eee-40ef-b1d5-4089e8e944d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:06.182346 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-45bd0a13-4eee-40ef-b1d5-4089e8e944d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:06.315248 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-45bd0a13-4eee-40ef-b1d5-4089e8e944d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:06.323630 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-45bd0a13-4eee-40ef-b1d5-4089e8e944d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:06.325165 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-45bd0a13-4eee-40ef-b1d5-4089e8e944d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:06.326257 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-45bd0a13-4eee-40ef-b1d5-4089e8e944d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1406 microversion: 2.20 time: 0.157046 Jan 19 13:11:06.326805 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 446/885] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:11:06 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:11:06.842707 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-7cf6b5d0-7306-4373-8e96-47fcf665cdbe req-fe43f1aa-b94e-40f5-9849-df3fabd2ae41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d2bd3e-47a3-4158-892e-627b3f1c1095", "name": "network-vif-plugged", "status": "completed", "tag": "e6862281-58ef-4013-962c-3a0024140b3a"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:06.844438 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:11:06.844438 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:11:06.853427 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-7cf6b5d0-7306-4373-8e96-47fcf665cdbe req-fe43f1aa-b94e-40f5-9849-df3fabd2ae41 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:06.853875 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-7cf6b5d0-7306-4373-8e96-47fcf665cdbe req-fe43f1aa-b94e-40f5-9849-df3fabd2ae41 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:06.867122 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-7cf6b5d0-7306-4373-8e96-47fcf665cdbe req-fe43f1aa-b94e-40f5-9849-df3fabd2ae41 service nova] Creating event network-vif-plugged:e6862281-58ef-4013-962c-3a0024140b3a for instance 16d2bd3e-47a3-4158-892e-627b3f1c1095 on hv-cinder-82301 Jan 19 13:11:06.872798 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-7cf6b5d0-7306-4373-8e96-47fcf665cdbe req-fe43f1aa-b94e-40f5-9849-df3fabd2ae41 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090174 Jan 19 13:11:06.873324 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 440/886] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:11:07.343625 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5a5f2f8e-0ae4-4d4e-84d4-3e7f0e6a8aae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:07.344261 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5a5f2f8e-0ae4-4d4e-84d4-3e7f0e6a8aae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:07.350629 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5a5f2f8e-0ae4-4d4e-84d4-3e7f0e6a8aae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:07.351078 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5a5f2f8e-0ae4-4d4e-84d4-3e7f0e6a8aae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:07.352223 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5a5f2f8e-0ae4-4d4e-84d4-3e7f0e6a8aae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:07.352761 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5a5f2f8e-0ae4-4d4e-84d4-3e7f0e6a8aae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:07.481818 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5a5f2f8e-0ae4-4d4e-84d4-3e7f0e6a8aae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:07.489561 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5a5f2f8e-0ae4-4d4e-84d4-3e7f0e6a8aae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:07.491075 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5a5f2f8e-0ae4-4d4e-84d4-3e7f0e6a8aae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:07.492463 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5a5f2f8e-0ae4-4d4e-84d4-3e7f0e6a8aae tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1406 microversion: 2.20 time: 0.152291 Jan 19 13:11:07.493032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 447/887] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:11:07 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:11:08.511958 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f3557bc1-c45d-448c-922d-b6a6537d10b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:08.512636 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f3557bc1-c45d-448c-922d-b6a6537d10b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:08.518743 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f3557bc1-c45d-448c-922d-b6a6537d10b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:08.519194 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f3557bc1-c45d-448c-922d-b6a6537d10b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:08.520016 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f3557bc1-c45d-448c-922d-b6a6537d10b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:08.520461 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f3557bc1-c45d-448c-922d-b6a6537d10b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:08.651627 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f3557bc1-c45d-448c-922d-b6a6537d10b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:08.659311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f3557bc1-c45d-448c-922d-b6a6537d10b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:08.660834 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f3557bc1-c45d-448c-922d-b6a6537d10b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:08.662027 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f3557bc1-c45d-448c-922d-b6a6537d10b3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1598 microversion: 2.20 time: 0.155332 Jan 19 13:11:08.662570 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 441/888] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:11:08 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:11:08.679426 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-658dbf57-750c-496d-b363-6ca97b2e35ff tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:08.680424 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-658dbf57-750c-496d-b363-6ca97b2e35ff tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:08.686676 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-658dbf57-750c-496d-b363-6ca97b2e35ff tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:08.687150 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-658dbf57-750c-496d-b363-6ca97b2e35ff tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:08.687903 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-658dbf57-750c-496d-b363-6ca97b2e35ff tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:08.688390 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-658dbf57-750c-496d-b363-6ca97b2e35ff tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:08.771944 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-658dbf57-750c-496d-b363-6ca97b2e35ff tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096267 Jan 19 13:11:08.772558 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 448/889] 10.222.0.48 () {60 vars in 1315 bytes} [Wed Jan 19 13:11:08 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:11:09.908972 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-27f13a35-4163-4acd-8e01-ea40d237b802 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:09.914610 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-41fc0015-0431-4c28-adfd-fe518816d8eb req-9c4aa60d-c9cd-4a4f-bd1f-643495f28ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d2bd3e-47a3-4158-892e-627b3f1c1095", "tag": "e6862281-58ef-4013-962c-3a0024140b3a"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:09.915671 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-27f13a35-4163-4acd-8e01-ea40d237b802 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:09.917019 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:11:09.917019 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:11:09.921929 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-27f13a35-4163-4acd-8e01-ea40d237b802 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:09.922423 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-27f13a35-4163-4acd-8e01-ea40d237b802 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:09.923281 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-27f13a35-4163-4acd-8e01-ea40d237b802 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:09.923753 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-41fc0015-0431-4c28-adfd-fe518816d8eb req-9c4aa60d-c9cd-4a4f-bd1f-643495f28ad6 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:09.923859 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-27f13a35-4163-4acd-8e01-ea40d237b802 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:09.924228 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-41fc0015-0431-4c28-adfd-fe518816d8eb req-9c4aa60d-c9cd-4a4f-bd1f-643495f28ad6 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:09.935741 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-41fc0015-0431-4c28-adfd-fe518816d8eb req-9c4aa60d-c9cd-4a4f-bd1f-643495f28ad6 service nova] Creating event network-changed:e6862281-58ef-4013-962c-3a0024140b3a for instance 16d2bd3e-47a3-4158-892e-627b3f1c1095 on hv-cinder-82301 Jan 19 13:11:09.941157 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-41fc0015-0431-4c28-adfd-fe518816d8eb req-9c4aa60d-c9cd-4a4f-bd1f-643495f28ad6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030392 Jan 19 13:11:09.942192 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 449/890] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:11:09.987937 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-27f13a35-4163-4acd-8e01-ea40d237b802 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 14 microversion: 2.20 time: 0.082514 Jan 19 13:11:09.988922 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 442/891] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:09 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:10.999264 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c2e409fc-4255-415f-a2cc-aa6b7dab0a23 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:11.000378 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c2e409fc-4255-415f-a2cc-aa6b7dab0a23 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:11.006793 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c2e409fc-4255-415f-a2cc-aa6b7dab0a23 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:11.007272 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c2e409fc-4255-415f-a2cc-aa6b7dab0a23 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:11.008622 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c2e409fc-4255-415f-a2cc-aa6b7dab0a23 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:11.009319 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c2e409fc-4255-415f-a2cc-aa6b7dab0a23 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:11.067390 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c2e409fc-4255-415f-a2cc-aa6b7dab0a23 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 14 microversion: 2.20 time: 0.072073 Jan 19 13:11:11.068367 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 450/892] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:10 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:11.899122 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-48848714-e12c-4ad7-a2f3-ece299c0b66d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:11.899744 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-48848714-e12c-4ad7-a2f3-ece299c0b66d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:11.906719 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-48848714-e12c-4ad7-a2f3-ece299c0b66d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:11.907167 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-48848714-e12c-4ad7-a2f3-ece299c0b66d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:11.907970 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-48848714-e12c-4ad7-a2f3-ece299c0b66d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:11.908433 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-48848714-e12c-4ad7-a2f3-ece299c0b66d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:11.933759 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.objects.instance [None req-48848714-e12c-4ad7-a2f3-ece299c0b66d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lazy-loading 'flavor' on Instance uuid f7ec4c20-aa67-4eef-b593-0387c00a3684 {{(pid=116360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:11:12.003005 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-48848714-e12c-4ad7-a2f3-ece299c0b66d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684/action" status: 202 len: 0 microversion: 2.1 time: 0.107781 Jan 19 13:11:12.004007 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 443/893] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:11:11 2022] POST /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:12.012862 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-655fb157-008a-48e3-a95b-a5e568fa9078 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:12.013566 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-655fb157-008a-48e3-a95b-a5e568fa9078 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:12.020809 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-655fb157-008a-48e3-a95b-a5e568fa9078 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:12.021289 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-655fb157-008a-48e3-a95b-a5e568fa9078 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:12.022093 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-655fb157-008a-48e3-a95b-a5e568fa9078 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:12.022672 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-655fb157-008a-48e3-a95b-a5e568fa9078 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:12.079287 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-cd592098-aca3-472b-b676-21040b691529 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:12.080372 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-cd592098-aca3-472b-b676-21040b691529 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:12.087037 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cd592098-aca3-472b-b676-21040b691529 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:12.087494 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cd592098-aca3-472b-b676-21040b691529 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:12.088329 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cd592098-aca3-472b-b676-21040b691529 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:12.088773 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cd592098-aca3-472b-b676-21040b691529 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:12.152296 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-cd592098-aca3-472b-b676-21040b691529 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 14 microversion: 2.20 time: 0.076668 Jan 19 13:11:12.155398 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 444/894] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:12 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:11:12.157379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-655fb157-008a-48e3-a95b-a5e568fa9078 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:12.165851 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-655fb157-008a-48e3-a95b-a5e568fa9078 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1568 microversion: 2.1 time: 0.157275 Jan 19 13:11:12.166412 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 451/895] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:12 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:13.163001 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5e6987e8-9bee-49e6-8a84-925aea530803 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:13.164542 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5e6987e8-9bee-49e6-8a84-925aea530803 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:13.171455 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e6987e8-9bee-49e6-8a84-925aea530803 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:13.171942 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e6987e8-9bee-49e6-8a84-925aea530803 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:13.172758 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e6987e8-9bee-49e6-8a84-925aea530803 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:13.173202 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e6987e8-9bee-49e6-8a84-925aea530803 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:13.182469 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9c948f43-df06-47ee-9ded-96f9b109c130 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:13.183523 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9c948f43-df06-47ee-9ded-96f9b109c130 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:13.189991 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9c948f43-df06-47ee-9ded-96f9b109c130 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:13.190444 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9c948f43-df06-47ee-9ded-96f9b109c130 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:13.191232 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9c948f43-df06-47ee-9ded-96f9b109c130 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:13.191677 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9c948f43-df06-47ee-9ded-96f9b109c130 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:13.239945 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5e6987e8-9bee-49e6-8a84-925aea530803 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 14 microversion: 2.20 time: 0.080874 Jan 19 13:11:13.240620 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 445/896] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:13 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:13.327644 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-9c948f43-df06-47ee-9ded-96f9b109c130 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:13.335103 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9c948f43-df06-47ee-9ded-96f9b109c130 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1568 microversion: 2.1 time: 0.156454 Jan 19 13:11:13.336375 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 452/897] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:13 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:11:14.251272 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f68eeef3-21c6-42f4-9312-f493454d5248 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:14.252311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f68eeef3-21c6-42f4-9312-f493454d5248 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:14.259629 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f68eeef3-21c6-42f4-9312-f493454d5248 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:14.260113 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f68eeef3-21c6-42f4-9312-f493454d5248 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:14.260891 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f68eeef3-21c6-42f4-9312-f493454d5248 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:14.261331 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f68eeef3-21c6-42f4-9312-f493454d5248 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:14.320879 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f68eeef3-21c6-42f4-9312-f493454d5248 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 14 microversion: 2.20 time: 0.073566 Jan 19 13:11:14.321479 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 446/898] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:14 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:14.353256 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6f7dcd56-a69a-4f5e-857f-02cd0adb474f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:14.353865 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6f7dcd56-a69a-4f5e-857f-02cd0adb474f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:14.360271 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f7dcd56-a69a-4f5e-857f-02cd0adb474f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:14.360723 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f7dcd56-a69a-4f5e-857f-02cd0adb474f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:14.361496 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f7dcd56-a69a-4f5e-857f-02cd0adb474f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:14.361934 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6f7dcd56-a69a-4f5e-857f-02cd0adb474f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:14.490973 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6f7dcd56-a69a-4f5e-857f-02cd0adb474f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:14.498599 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6f7dcd56-a69a-4f5e-857f-02cd0adb474f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1568 microversion: 2.1 time: 0.149587 Jan 19 13:11:14.499099 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 453/899] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:14 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:15.332506 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4825ba94-8e71-4a75-821d-3497efb8a5fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:15.333470 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4825ba94-8e71-4a75-821d-3497efb8a5fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:15.340812 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4825ba94-8e71-4a75-821d-3497efb8a5fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:15.341264 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4825ba94-8e71-4a75-821d-3497efb8a5fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:15.342058 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4825ba94-8e71-4a75-821d-3497efb8a5fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:15.342493 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4825ba94-8e71-4a75-821d-3497efb8a5fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:15.404072 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4825ba94-8e71-4a75-821d-3497efb8a5fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 14 microversion: 2.20 time: 0.075654 Jan 19 13:11:15.404687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 447/900] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:15 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:15.515380 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-15f72e0c-7737-495a-8c3f-58cc6c214a2b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:15.516005 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-15f72e0c-7737-495a-8c3f-58cc6c214a2b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:15.522282 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-15f72e0c-7737-495a-8c3f-58cc6c214a2b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:15.522778 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-15f72e0c-7737-495a-8c3f-58cc6c214a2b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:15.524141 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-15f72e0c-7737-495a-8c3f-58cc6c214a2b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:15.524582 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-15f72e0c-7737-495a-8c3f-58cc6c214a2b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:15.653421 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-15f72e0c-7737-495a-8c3f-58cc6c214a2b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:15.660768 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-15f72e0c-7737-495a-8c3f-58cc6c214a2b tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1568 microversion: 2.1 time: 0.149110 Jan 19 13:11:15.661338 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 454/901] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:15 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:16.415906 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0fa7bf65-ab43-4749-994a-65f756f6f043 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:16.416945 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0fa7bf65-ab43-4749-994a-65f756f6f043 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:16.423784 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0fa7bf65-ab43-4749-994a-65f756f6f043 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:16.424299 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0fa7bf65-ab43-4749-994a-65f756f6f043 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:16.425086 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0fa7bf65-ab43-4749-994a-65f756f6f043 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:16.425523 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0fa7bf65-ab43-4749-994a-65f756f6f043 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:16.485138 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0fa7bf65-ab43-4749-994a-65f756f6f043 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 14 microversion: 2.20 time: 0.073916 Jan 19 13:11:16.485776 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 448/902] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:16 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:16.678164 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9f6205cd-20fc-445f-92d4-447ebe1624be tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:16.678792 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9f6205cd-20fc-445f-92d4-447ebe1624be tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:16.685570 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9f6205cd-20fc-445f-92d4-447ebe1624be tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:16.686015 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9f6205cd-20fc-445f-92d4-447ebe1624be tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:16.686789 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9f6205cd-20fc-445f-92d4-447ebe1624be tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:16.687217 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9f6205cd-20fc-445f-92d4-447ebe1624be tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:16.821559 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-9f6205cd-20fc-445f-92d4-447ebe1624be tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:16.828903 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9f6205cd-20fc-445f-92d4-447ebe1624be tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1568 microversion: 2.1 time: 0.154375 Jan 19 13:11:16.829466 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 455/903] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:16 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:17.497501 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-36c8e76e-f33a-4474-a180-7947dcb6905f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:17.498499 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-36c8e76e-f33a-4474-a180-7947dcb6905f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:17.505347 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-36c8e76e-f33a-4474-a180-7947dcb6905f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:17.505803 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-36c8e76e-f33a-4474-a180-7947dcb6905f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:17.506571 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-36c8e76e-f33a-4474-a180-7947dcb6905f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:17.507101 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-36c8e76e-f33a-4474-a180-7947dcb6905f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:17.575964 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-36c8e76e-f33a-4474-a180-7947dcb6905f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 14 microversion: 2.20 time: 0.082465 Jan 19 13:11:17.576613 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 449/904] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:17 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:17.845886 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4f39bee1-e902-4776-9426-e2eb202da49a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:17.846495 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4f39bee1-e902-4776-9426-e2eb202da49a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:17.853746 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f39bee1-e902-4776-9426-e2eb202da49a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:17.854194 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f39bee1-e902-4776-9426-e2eb202da49a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:17.854968 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f39bee1-e902-4776-9426-e2eb202da49a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:17.855428 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f39bee1-e902-4776-9426-e2eb202da49a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:17.984100 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4f39bee1-e902-4776-9426-e2eb202da49a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:17.991301 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4f39bee1-e902-4776-9426-e2eb202da49a tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1568 microversion: 2.1 time: 0.149055 Jan 19 13:11:17.993087 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 456/905] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:17 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:18.587946 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5c120f0a-f5a2-44bf-ad93-6f0569c2db76 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:18.588931 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5c120f0a-f5a2-44bf-ad93-6f0569c2db76 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:18.595885 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5c120f0a-f5a2-44bf-ad93-6f0569c2db76 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:18.596372 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5c120f0a-f5a2-44bf-ad93-6f0569c2db76 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:18.597154 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5c120f0a-f5a2-44bf-ad93-6f0569c2db76 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:18.597602 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5c120f0a-f5a2-44bf-ad93-6f0569c2db76 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:18.653790 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5c120f0a-f5a2-44bf-ad93-6f0569c2db76 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 14 microversion: 2.20 time: 0.070495 Jan 19 13:11:18.654400 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 450/906] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:18 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:19.009782 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-25e3b74a-13f4-4388-9c4e-72519bb39187 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:19.010382 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-25e3b74a-13f4-4388-9c4e-72519bb39187 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:19.016726 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-25e3b74a-13f4-4388-9c4e-72519bb39187 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:19.017176 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-25e3b74a-13f4-4388-9c4e-72519bb39187 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:19.017951 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-25e3b74a-13f4-4388-9c4e-72519bb39187 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:19.018391 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-25e3b74a-13f4-4388-9c4e-72519bb39187 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:19.152196 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-25e3b74a-13f4-4388-9c4e-72519bb39187 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:19.159840 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-25e3b74a-13f4-4388-9c4e-72519bb39187 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1568 microversion: 2.1 time: 0.154637 Jan 19 13:11:19.160433 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 457/907] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:19 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:11:19.665669 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4d58880b-3d62-4a3d-87fc-154e8d718fb9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:19.666662 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4d58880b-3d62-4a3d-87fc-154e8d718fb9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:19.673432 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4d58880b-3d62-4a3d-87fc-154e8d718fb9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:19.673876 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4d58880b-3d62-4a3d-87fc-154e8d718fb9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:19.674646 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4d58880b-3d62-4a3d-87fc-154e8d718fb9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:19.675076 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4d58880b-3d62-4a3d-87fc-154e8d718fb9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:19.735172 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4d58880b-3d62-4a3d-87fc-154e8d718fb9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 14 microversion: 2.20 time: 0.074052 Jan 19 13:11:19.735762 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 451/908] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:19 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:20.176492 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a983354f-c3af-48ae-a3ad-7ba6504a2351 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:20.177099 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a983354f-c3af-48ae-a3ad-7ba6504a2351 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:20.183696 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a983354f-c3af-48ae-a3ad-7ba6504a2351 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:20.184196 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a983354f-c3af-48ae-a3ad-7ba6504a2351 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:20.184975 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a983354f-c3af-48ae-a3ad-7ba6504a2351 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:20.185416 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a983354f-c3af-48ae-a3ad-7ba6504a2351 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:20.316009 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-a983354f-c3af-48ae-a3ad-7ba6504a2351 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:20.323740 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a983354f-c3af-48ae-a3ad-7ba6504a2351 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1568 microversion: 2.1 time: 0.150989 Jan 19 13:11:20.324325 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 458/909] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:20 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:20.746968 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-aa5e5227-519b-4744-a8d9-cfd1104f46d8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:20.747962 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-aa5e5227-519b-4744-a8d9-cfd1104f46d8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:20.754758 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa5e5227-519b-4744-a8d9-cfd1104f46d8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:20.755213 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa5e5227-519b-4744-a8d9-cfd1104f46d8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:20.755970 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa5e5227-519b-4744-a8d9-cfd1104f46d8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:20.756426 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-aa5e5227-519b-4744-a8d9-cfd1104f46d8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:20.813972 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-aa5e5227-519b-4744-a8d9-cfd1104f46d8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 14 microversion: 2.20 time: 0.070893 Jan 19 13:11:20.814586 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 452/910] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:20 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:11:21.340262 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c5ffa34f-9d96-4361-b166-165b72333b18 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:21.340864 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c5ffa34f-9d96-4361-b166-165b72333b18 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:21.347053 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5ffa34f-9d96-4361-b166-165b72333b18 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:21.347497 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5ffa34f-9d96-4361-b166-165b72333b18 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:21.348284 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5ffa34f-9d96-4361-b166-165b72333b18 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:21.348720 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5ffa34f-9d96-4361-b166-165b72333b18 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:21.478436 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-c5ffa34f-9d96-4361-b166-165b72333b18 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:21.485827 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c5ffa34f-9d96-4361-b166-165b72333b18 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1568 microversion: 2.1 time: 0.149165 Jan 19 13:11:21.486397 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 459/911] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:21 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:11:21.826007 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-21b4a5a6-e7b6-4e32-92fc-934e2f4d6300 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:21.827726 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-21b4a5a6-e7b6-4e32-92fc-934e2f4d6300 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:21.840790 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-21b4a5a6-e7b6-4e32-92fc-934e2f4d6300 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:21.841239 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-21b4a5a6-e7b6-4e32-92fc-934e2f4d6300 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:21.842814 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-21b4a5a6-e7b6-4e32-92fc-934e2f4d6300 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:21.843249 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-21b4a5a6-e7b6-4e32-92fc-934e2f4d6300 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:21.923468 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-21b4a5a6-e7b6-4e32-92fc-934e2f4d6300 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 10893 microversion: 2.20 time: 0.101737 Jan 19 13:11:21.924076 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 453/912] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:21 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 10893 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:11:22.502523 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6566e060-08c8-477f-af76-43a7c02b4e05 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:22.503089 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6566e060-08c8-477f-af76-43a7c02b4e05 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:22.510125 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6566e060-08c8-477f-af76-43a7c02b4e05 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:22.510577 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6566e060-08c8-477f-af76-43a7c02b4e05 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:22.511353 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6566e060-08c8-477f-af76-43a7c02b4e05 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:22.511789 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6566e060-08c8-477f-af76-43a7c02b4e05 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:22.731148 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6566e060-08c8-477f-af76-43a7c02b4e05 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:22.738475 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6566e060-08c8-477f-af76-43a7c02b4e05 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1568 microversion: 2.1 time: 0.239702 Jan 19 13:11:22.739033 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 460/913] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:22 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:22.935262 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f267e5a7-45d5-422d-9423-5332fd0cfda3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:22.936311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f267e5a7-45d5-422d-9423-5332fd0cfda3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:22.943161 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f267e5a7-45d5-422d-9423-5332fd0cfda3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:22.943618 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f267e5a7-45d5-422d-9423-5332fd0cfda3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:22.945074 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f267e5a7-45d5-422d-9423-5332fd0cfda3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:22.945588 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f267e5a7-45d5-422d-9423-5332fd0cfda3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:23.026600 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f267e5a7-45d5-422d-9423-5332fd0cfda3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 17861 microversion: 2.20 time: 0.095380 Jan 19 13:11:23.027214 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 454/914] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:22 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 17861 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:23.756303 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5720aa77-b4f0-47cf-8fa9-9489159ac7d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:23.757515 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5720aa77-b4f0-47cf-8fa9-9489159ac7d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:23.764077 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5720aa77-b4f0-47cf-8fa9-9489159ac7d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:23.764532 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5720aa77-b4f0-47cf-8fa9-9489159ac7d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:23.765322 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5720aa77-b4f0-47cf-8fa9-9489159ac7d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:23.765798 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5720aa77-b4f0-47cf-8fa9-9489159ac7d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:23.910224 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5720aa77-b4f0-47cf-8fa9-9489159ac7d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:23.917829 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5720aa77-b4f0-47cf-8fa9-9489159ac7d4 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1568 microversion: 2.1 time: 0.165547 Jan 19 13:11:23.918576 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 461/915] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:23 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:24.038678 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b76a2a5e-1152-40e4-b95c-cb0130870c2f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:24.039740 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b76a2a5e-1152-40e4-b95c-cb0130870c2f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:24.046883 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b76a2a5e-1152-40e4-b95c-cb0130870c2f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:24.047335 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b76a2a5e-1152-40e4-b95c-cb0130870c2f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:24.048155 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b76a2a5e-1152-40e4-b95c-cb0130870c2f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:24.048602 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b76a2a5e-1152-40e4-b95c-cb0130870c2f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:24.170414 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b76a2a5e-1152-40e4-b95c-cb0130870c2f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 18356 microversion: 2.20 time: 0.135755 Jan 19 13:11:24.174122 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 455/916] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:24 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 18356 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:24.935017 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-040f3495-a45a-4acc-bb54-5f7b8fb3e78d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:24.935625 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-040f3495-a45a-4acc-bb54-5f7b8fb3e78d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:24.941958 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-040f3495-a45a-4acc-bb54-5f7b8fb3e78d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:24.942410 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-040f3495-a45a-4acc-bb54-5f7b8fb3e78d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:24.943193 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-040f3495-a45a-4acc-bb54-5f7b8fb3e78d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:24.943633 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-040f3495-a45a-4acc-bb54-5f7b8fb3e78d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:25.081433 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-040f3495-a45a-4acc-bb54-5f7b8fb3e78d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:25.089234 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-040f3495-a45a-4acc-bb54-5f7b8fb3e78d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1569 microversion: 2.1 time: 0.157995 Jan 19 13:11:25.089802 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 462/917] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:24 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:25.106108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c7e5e033-fc45-4b8e-929d-6070f921b5c8 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:25.106776 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c7e5e033-fc45-4b8e-929d-6070f921b5c8 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:25.114956 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c7e5e033-fc45-4b8e-929d-6070f921b5c8 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:25.115426 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c7e5e033-fc45-4b8e-929d-6070f921b5c8 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:25.116949 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c7e5e033-fc45-4b8e-929d-6070f921b5c8 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:25.117566 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c7e5e033-fc45-4b8e-929d-6070f921b5c8 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:25.182719 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b1f3b2e5-aaf2-47b4-b230-9b87c3d6b197 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:25.183775 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b1f3b2e5-aaf2-47b4-b230-9b87c3d6b197 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:25.190381 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b1f3b2e5-aaf2-47b4-b230-9b87c3d6b197 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:25.190838 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b1f3b2e5-aaf2-47b4-b230-9b87c3d6b197 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:25.192050 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b1f3b2e5-aaf2-47b4-b230-9b87c3d6b197 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:25.192177 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b1f3b2e5-aaf2-47b4-b230-9b87c3d6b197 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:25.206376 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c7e5e033-fc45-4b8e-929d-6070f921b5c8 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684/action" status: 202 len: 0 microversion: 2.1 time: 0.104257 Jan 19 13:11:25.206974 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 456/918] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:11:25 2022] POST /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:25.214787 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d6d9e13e-0438-418f-a0d4-434b48207a53 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:25.215900 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d6d9e13e-0438-418f-a0d4-434b48207a53 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:25.222012 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d6d9e13e-0438-418f-a0d4-434b48207a53 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:25.222472 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d6d9e13e-0438-418f-a0d4-434b48207a53 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:25.223261 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d6d9e13e-0438-418f-a0d4-434b48207a53 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:25.223701 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d6d9e13e-0438-418f-a0d4-434b48207a53 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:25.265764 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b1f3b2e5-aaf2-47b4-b230-9b87c3d6b197 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 20997 microversion: 2.20 time: 0.087560 Jan 19 13:11:25.266465 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 463/919] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:25 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 20997 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:11:25.357963 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d6d9e13e-0438-418f-a0d4-434b48207a53 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:25.370337 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d6d9e13e-0438-418f-a0d4-434b48207a53 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1517 microversion: 2.1 time: 0.155220 Jan 19 13:11:25.370949 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 457/920] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:25 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:11:26.279498 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-18c2f8df-599e-4b1b-9cdb-96e393da9977 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:26.280524 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-18c2f8df-599e-4b1b-9cdb-96e393da9977 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:26.287426 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-18c2f8df-599e-4b1b-9cdb-96e393da9977 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:26.287880 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-18c2f8df-599e-4b1b-9cdb-96e393da9977 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:26.289021 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-18c2f8df-599e-4b1b-9cdb-96e393da9977 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:26.289647 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-18c2f8df-599e-4b1b-9cdb-96e393da9977 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:26.362258 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-18c2f8df-599e-4b1b-9cdb-96e393da9977 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 22852 microversion: 2.20 time: 0.086810 Jan 19 13:11:26.362898 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 464/921] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:26 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 22852 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:11:26.387468 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2a72699e-97c4-41e4-b4b4-d0e77cfa94f5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:26.388133 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2a72699e-97c4-41e4-b4b4-d0e77cfa94f5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:26.394536 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2a72699e-97c4-41e4-b4b4-d0e77cfa94f5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:26.394992 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2a72699e-97c4-41e4-b4b4-d0e77cfa94f5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:26.395811 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2a72699e-97c4-41e4-b4b4-d0e77cfa94f5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:26.396289 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2a72699e-97c4-41e4-b4b4-d0e77cfa94f5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:26.555032 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2a72699e-97c4-41e4-b4b4-d0e77cfa94f5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:26.562545 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2a72699e-97c4-41e4-b4b4-d0e77cfa94f5 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1575 microversion: 2.1 time: 0.179103 Jan 19 13:11:26.563109 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 458/922] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:26 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:27.373821 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7b6c543e-f73a-40ed-9b5e-07d7abc24df2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:27.374834 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7b6c543e-f73a-40ed-9b5e-07d7abc24df2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:27.381700 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7b6c543e-f73a-40ed-9b5e-07d7abc24df2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:27.382156 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7b6c543e-f73a-40ed-9b5e-07d7abc24df2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:27.383159 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7b6c543e-f73a-40ed-9b5e-07d7abc24df2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:27.383860 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7b6c543e-f73a-40ed-9b5e-07d7abc24df2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:27.470109 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7b6c543e-f73a-40ed-9b5e-07d7abc24df2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 23804 microversion: 2.20 time: 0.100256 Jan 19 13:11:27.470754 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 465/923] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:27 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 23804 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:27.580185 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7da1a2ae-94f3-41d1-879a-8e343338582e tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:27.580868 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7da1a2ae-94f3-41d1-879a-8e343338582e tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:27.587777 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7da1a2ae-94f3-41d1-879a-8e343338582e tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:27.588260 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7da1a2ae-94f3-41d1-879a-8e343338582e tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:27.589043 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7da1a2ae-94f3-41d1-879a-8e343338582e tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:27.589484 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7da1a2ae-94f3-41d1-879a-8e343338582e tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:27.717394 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7da1a2ae-94f3-41d1-879a-8e343338582e tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:27.724668 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7da1a2ae-94f3-41d1-879a-8e343338582e tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1575 microversion: 2.1 time: 0.148103 Jan 19 13:11:27.725229 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 459/924] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:27 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:28.482578 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-db3dc661-a9ed-4105-8c68-87c40bb64804 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:28.483593 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-db3dc661-a9ed-4105-8c68-87c40bb64804 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:28.490829 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-db3dc661-a9ed-4105-8c68-87c40bb64804 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:28.491283 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-db3dc661-a9ed-4105-8c68-87c40bb64804 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:28.492890 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-db3dc661-a9ed-4105-8c68-87c40bb64804 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:28.493335 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-db3dc661-a9ed-4105-8c68-87c40bb64804 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:28.570106 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-db3dc661-a9ed-4105-8c68-87c40bb64804 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 25414 microversion: 2.20 time: 0.091318 Jan 19 13:11:28.570892 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 466/925] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:28 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 25414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:28.741465 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-887e1f4e-01cc-444b-a50e-dc9ccdd9896c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:28.742441 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-887e1f4e-01cc-444b-a50e-dc9ccdd9896c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:28.750153 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-887e1f4e-01cc-444b-a50e-dc9ccdd9896c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:28.750921 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-887e1f4e-01cc-444b-a50e-dc9ccdd9896c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:28.751422 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-887e1f4e-01cc-444b-a50e-dc9ccdd9896c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:28.751862 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-887e1f4e-01cc-444b-a50e-dc9ccdd9896c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:28.866266 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-ba1a1a05-ab50-4e2c-ba72-97dc878bce9e req-0c817ae2-d450-4b43-9b9b-0c40b98026d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ec4c20-aa67-4eef-b593-0387c00a3684", "name": "network-vif-unplugged", "status": "completed", "tag": "d543cda5-e012-413e-a613-191a01247465"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:28.868494 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:11:28.868494 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:11:28.876226 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-ba1a1a05-ab50-4e2c-ba72-97dc878bce9e req-0c817ae2-d450-4b43-9b9b-0c40b98026d3 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:28.876670 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-ba1a1a05-ab50-4e2c-ba72-97dc878bce9e req-0c817ae2-d450-4b43-9b9b-0c40b98026d3 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:28.889464 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-ba1a1a05-ab50-4e2c-ba72-97dc878bce9e req-0c817ae2-d450-4b43-9b9b-0c40b98026d3 service nova] Creating event network-vif-unplugged:d543cda5-e012-413e-a613-191a01247465 for instance f7ec4c20-aa67-4eef-b593-0387c00a3684 on hv-cinder-82301 Jan 19 13:11:28.894233 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-ba1a1a05-ab50-4e2c-ba72-97dc878bce9e req-0c817ae2-d450-4b43-9b9b-0c40b98026d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031947 Jan 19 13:11:28.894976 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 467/926] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:11:28.903878 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-887e1f4e-01cc-444b-a50e-dc9ccdd9896c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:28.911463 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-887e1f4e-01cc-444b-a50e-dc9ccdd9896c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1575 microversion: 2.1 time: 0.173895 Jan 19 13:11:28.912035 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 460/927] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:28 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:29.582418 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3a47c70c-81c1-4db0-b2f9-6066f17c1f08 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:29.583402 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3a47c70c-81c1-4db0-b2f9-6066f17c1f08 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:29.589711 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3a47c70c-81c1-4db0-b2f9-6066f17c1f08 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:29.590158 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3a47c70c-81c1-4db0-b2f9-6066f17c1f08 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:29.590927 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3a47c70c-81c1-4db0-b2f9-6066f17c1f08 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:29.591365 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3a47c70c-81c1-4db0-b2f9-6066f17c1f08 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:29.667710 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3a47c70c-81c1-4db0-b2f9-6066f17c1f08 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 26790 microversion: 2.20 time: 0.089600 Jan 19 13:11:29.668363 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 468/928] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:29 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 26790 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:29.927894 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-36b493db-d756-4e64-a51f-0626f7aa9348 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:29.928559 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-36b493db-d756-4e64-a51f-0626f7aa9348 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:29.935437 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-36b493db-d756-4e64-a51f-0626f7aa9348 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:29.935897 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-36b493db-d756-4e64-a51f-0626f7aa9348 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:29.936711 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-36b493db-d756-4e64-a51f-0626f7aa9348 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:29.937153 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-36b493db-d756-4e64-a51f-0626f7aa9348 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:30.065366 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-36b493db-d756-4e64-a51f-0626f7aa9348 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:30.072633 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-36b493db-d756-4e64-a51f-0626f7aa9348 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1575 microversion: 2.1 time: 0.148442 Jan 19 13:11:30.073203 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 461/929] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:29 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:30.680024 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a40f557a-0beb-496c-bdcd-c073eeed5078 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:30.681032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a40f557a-0beb-496c-bdcd-c073eeed5078 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:30.687855 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a40f557a-0beb-496c-bdcd-c073eeed5078 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:30.688335 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a40f557a-0beb-496c-bdcd-c073eeed5078 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:30.689116 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a40f557a-0beb-496c-bdcd-c073eeed5078 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:30.689555 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a40f557a-0beb-496c-bdcd-c073eeed5078 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:30.778390 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a40f557a-0beb-496c-bdcd-c073eeed5078 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 27671 microversion: 2.20 time: 0.103003 Jan 19 13:11:30.779046 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 469/930] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:30 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 27671 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:30.882179 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ddbacc0f-4a33-4085-b5fd-98de8f496ca5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:30.883145 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ddbacc0f-4a33-4085-b5fd-98de8f496ca5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:30.889326 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ddbacc0f-4a33-4085-b5fd-98de8f496ca5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:30.889778 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ddbacc0f-4a33-4085-b5fd-98de8f496ca5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:30.890550 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ddbacc0f-4a33-4085-b5fd-98de8f496ca5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:30.890991 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ddbacc0f-4a33-4085-b5fd-98de8f496ca5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:30.919712 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ddbacc0f-4a33-4085-b5fd-98de8f496ca5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041282 Jan 19 13:11:30.920284 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 462/931] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:11:30 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:11:30.974876 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-104b3cc9-5780-477a-aa2c-7ef884c58a87 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:30.975462 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-104b3cc9-5780-477a-aa2c-7ef884c58a87 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:30.983429 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-104b3cc9-5780-477a-aa2c-7ef884c58a87 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:30.983882 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-104b3cc9-5780-477a-aa2c-7ef884c58a87 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:30.984724 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-104b3cc9-5780-477a-aa2c-7ef884c58a87 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:30.985160 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-104b3cc9-5780-477a-aa2c-7ef884c58a87 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:31.090139 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4ad13668-f12a-4a2d-83f1-c8cee8d88a77 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:31.090760 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4ad13668-f12a-4a2d-83f1-c8cee8d88a77 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:31.097932 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4ad13668-f12a-4a2d-83f1-c8cee8d88a77 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:31.098390 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4ad13668-f12a-4a2d-83f1-c8cee8d88a77 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:31.099207 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4ad13668-f12a-4a2d-83f1-c8cee8d88a77 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:31.099654 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4ad13668-f12a-4a2d-83f1-c8cee8d88a77 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:31.168264 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-104b3cc9-5780-477a-aa2c-7ef884c58a87 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Going to try to terminate instance {{(pid=116361) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:11:31.235132 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4ad13668-f12a-4a2d-83f1-c8cee8d88a77 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:31.243103 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4ad13668-f12a-4a2d-83f1-c8cee8d88a77 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1575 microversion: 2.1 time: 0.156566 Jan 19 13:11:31.243812 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 463/932] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:31 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:11:31.247198 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-104b3cc9-5780-477a-aa2c-7ef884c58a87 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 204 len: 0 microversion: 2.1 time: 0.276497 Jan 19 13:11:31.250838 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 470/933] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:11:30 2022] DELETE /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:11:31.255676 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f07eb3c8-f4b6-4dbc-9a9f-20c6b5179727 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:31.256425 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f07eb3c8-f4b6-4dbc-9a9f-20c6b5179727 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:31.263605 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f07eb3c8-f4b6-4dbc-9a9f-20c6b5179727 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:31.264089 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f07eb3c8-f4b6-4dbc-9a9f-20c6b5179727 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:31.264878 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f07eb3c8-f4b6-4dbc-9a9f-20c6b5179727 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:31.265323 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f07eb3c8-f4b6-4dbc-9a9f-20c6b5179727 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:31.397627 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f07eb3c8-f4b6-4dbc-9a9f-20c6b5179727 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:31.404887 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f07eb3c8-f4b6-4dbc-9a9f-20c6b5179727 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1672 microversion: 2.1 time: 0.152922 Jan 19 13:11:31.405446 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 464/934] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:31 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:11:31.790543 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-80178a3a-ef53-4704-9989-d8b9e32f1bdf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:31.791549 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-80178a3a-ef53-4704-9989-d8b9e32f1bdf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:31.799260 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-80178a3a-ef53-4704-9989-d8b9e32f1bdf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:31.799713 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-80178a3a-ef53-4704-9989-d8b9e32f1bdf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:31.800534 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-80178a3a-ef53-4704-9989-d8b9e32f1bdf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:31.800975 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-80178a3a-ef53-4704-9989-d8b9e32f1bdf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:31.875123 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-80178a3a-ef53-4704-9989-d8b9e32f1bdf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 27982 microversion: 2.20 time: 0.088557 Jan 19 13:11:31.875788 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 471/935] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:31 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 27982 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:32.260769 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-1ad07bea-d5c8-4025-9b06-870f27291e43 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:32.261398 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-1ad07bea-d5c8-4025-9b06-870f27291e43 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:32.267671 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1ad07bea-d5c8-4025-9b06-870f27291e43 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:32.268084 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1ad07bea-d5c8-4025-9b06-870f27291e43 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:32.268859 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1ad07bea-d5c8-4025-9b06-870f27291e43 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:32.269312 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1ad07bea-d5c8-4025-9b06-870f27291e43 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:32.402985 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-1ad07bea-d5c8-4025-9b06-870f27291e43 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:32.410659 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-1ad07bea-d5c8-4025-9b06-870f27291e43 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1575 microversion: 2.1 time: 0.154294 Jan 19 13:11:32.411230 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 465/936] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:32 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:32.422075 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e27761f2-c4c1-4c8d-96b5-cfd23e894645 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:32.422797 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e27761f2-c4c1-4c8d-96b5-cfd23e894645 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:32.430283 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e27761f2-c4c1-4c8d-96b5-cfd23e894645 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:32.430739 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e27761f2-c4c1-4c8d-96b5-cfd23e894645 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:32.431520 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e27761f2-c4c1-4c8d-96b5-cfd23e894645 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:32.431958 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e27761f2-c4c1-4c8d-96b5-cfd23e894645 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:32.569357 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e27761f2-c4c1-4c8d-96b5-cfd23e894645 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:32.577821 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e27761f2-c4c1-4c8d-96b5-cfd23e894645 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1672 microversion: 2.1 time: 0.160039 Jan 19 13:11:32.578380 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 472/937] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:32 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:32.887469 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-226d8034-6628-4c05-8824-1fac12d7bb7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:32.888436 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-226d8034-6628-4c05-8824-1fac12d7bb7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:32.894980 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-226d8034-6628-4c05-8824-1fac12d7bb7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:32.895431 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-226d8034-6628-4c05-8824-1fac12d7bb7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:32.896260 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-226d8034-6628-4c05-8824-1fac12d7bb7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:32.896695 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-226d8034-6628-4c05-8824-1fac12d7bb7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:32.982548 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-226d8034-6628-4c05-8824-1fac12d7bb7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28216 microversion: 2.20 time: 0.098886 Jan 19 13:11:32.983262 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 466/938] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:32 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28216 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:33.428120 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5c95e87e-84ae-4fb9-ad71-a2fb60bec32f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:33.428802 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5c95e87e-84ae-4fb9-ad71-a2fb60bec32f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:33.436649 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5c95e87e-84ae-4fb9-ad71-a2fb60bec32f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:33.437101 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5c95e87e-84ae-4fb9-ad71-a2fb60bec32f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:33.437897 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5c95e87e-84ae-4fb9-ad71-a2fb60bec32f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:33.438337 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5c95e87e-84ae-4fb9-ad71-a2fb60bec32f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:33.595321 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ca428655-9f6f-4c09-a39d-2726bb4250c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:33.596386 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ca428655-9f6f-4c09-a39d-2726bb4250c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:33.604516 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ca428655-9f6f-4c09-a39d-2726bb4250c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:33.604899 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ca428655-9f6f-4c09-a39d-2726bb4250c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:33.605735 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ca428655-9f6f-4c09-a39d-2726bb4250c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:33.606321 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ca428655-9f6f-4c09-a39d-2726bb4250c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:33.726620 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ca428655-9f6f-4c09-a39d-2726bb4250c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:33.734019 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ca428655-9f6f-4c09-a39d-2726bb4250c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 200 len: 1605 microversion: 2.1 time: 0.142806 Jan 19 13:11:33.734587 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 467/939] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:33 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 1605 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:33.826938 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-b4b3f8e5-92ec-4d93-a9d7-ebccef813318 req-13beb2fc-36c1-42e3-b805-874c61e0db7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c0570c-1d8d-41ff-9ec2-9325d1a121ca", "name": "network-vif-deleted", "tag": "ffc3ee9b-e03d-44c4-a33d-39af979abf14"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:33.830668 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:11:33.830668 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:11:33.843285 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-b4b3f8e5-92ec-4d93-a9d7-ebccef813318 req-13beb2fc-36c1-42e3-b805-874c61e0db7f service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:33.843732 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-b4b3f8e5-92ec-4d93-a9d7-ebccef813318 req-13beb2fc-36c1-42e3-b805-874c61e0db7f service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:33.851425 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5c95e87e-84ae-4fb9-ad71-a2fb60bec32f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:33.858843 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-b4b3f8e5-92ec-4d93-a9d7-ebccef813318 req-13beb2fc-36c1-42e3-b805-874c61e0db7f service nova] Creating event network-vif-deleted:ffc3ee9b-e03d-44c4-a33d-39af979abf14 for instance e4c0570c-1d8d-41ff-9ec2-9325d1a121ca on hv-cinder-82301 Jan 19 13:11:33.859229 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5c95e87e-84ae-4fb9-ad71-a2fb60bec32f tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1575 microversion: 2.1 time: 0.435071 Jan 19 13:11:33.859807 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 473/940] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:33 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1575 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:33.885628 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-b4b3f8e5-92ec-4d93-a9d7-ebccef813318 req-13beb2fc-36c1-42e3-b805-874c61e0db7f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062116 Jan 19 13:11:33.886585 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 468/941] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:11:33.994134 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ed8fda73-a126-4174-b0eb-876f1384666c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:33.995114 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ed8fda73-a126-4174-b0eb-876f1384666c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:34.001172 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed8fda73-a126-4174-b0eb-876f1384666c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:34.001633 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed8fda73-a126-4174-b0eb-876f1384666c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:34.002422 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed8fda73-a126-4174-b0eb-876f1384666c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:34.002868 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed8fda73-a126-4174-b0eb-876f1384666c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:34.071673 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ed8fda73-a126-4174-b0eb-876f1384666c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28216 microversion: 2.20 time: 0.081654 Jan 19 13:11:34.072652 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 474/942] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:33 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28216 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:34.751801 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7fdf26c6-a61e-4baa-9a25-52a890a07d18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:34.752553 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7fdf26c6-a61e-4baa-9a25-52a890a07d18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:34.759611 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fdf26c6-a61e-4baa-9a25-52a890a07d18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:34.760090 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fdf26c6-a61e-4baa-9a25-52a890a07d18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:34.760871 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fdf26c6-a61e-4baa-9a25-52a890a07d18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:34.761314 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fdf26c6-a61e-4baa-9a25-52a890a07d18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:34.775646 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-7fdf26c6-a61e-4baa-9a25-52a890a07d18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] HTTP exception thrown: Instance e4c0570c-1d8d-41ff-9ec2-9325d1a121ca could not be found. Jan 19 13:11:34.776262 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7fdf26c6-a61e-4baa-9a25-52a890a07d18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Returning 404 to user: Instance e4c0570c-1d8d-41ff-9ec2-9325d1a121ca could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:11:34.777086 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7fdf26c6-a61e-4baa-9a25-52a890a07d18 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 404 len: 111 microversion: 2.1 time: 0.029825 Jan 19 13:11:34.777628 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 469/943] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:34 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:11:34.786357 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9edd2d3a-4972-4083-a974-e733c86b8ad0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '.version_select at 0x7f07d7b1d790>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:34.806055 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9edd2d3a-4972-4083-a974-e733c86b8ad0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617687012" status: 202 len: 0 microversion: 2.1 time: 0.023677 Jan 19 13:11:34.806721 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 475/944] 10.222.0.48 () {58 vars in 1220 bytes} [Wed Jan 19 13:11:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617687012 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:34.879601 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-052dd6d6-0fa6-4ef6-a90a-703af4a2e4a8 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:34.880324 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-052dd6d6-0fa6-4ef6-a90a-703af4a2e4a8 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:34.886520 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-052dd6d6-0fa6-4ef6-a90a-703af4a2e4a8 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:34.887043 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-052dd6d6-0fa6-4ef6-a90a-703af4a2e4a8 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:34.887884 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-052dd6d6-0fa6-4ef6-a90a-703af4a2e4a8 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:34.888406 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-052dd6d6-0fa6-4ef6-a90a-703af4a2e4a8 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:35.034628 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-052dd6d6-0fa6-4ef6-a90a-703af4a2e4a8 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:35.042937 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-052dd6d6-0fa6-4ef6-a90a-703af4a2e4a8 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1575 microversion: 2.1 time: 0.166898 Jan 19 13:11:35.043525 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 470/945] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:34 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:35.084157 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9d470eda-e44c-4583-ac6c-7e6886448166 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:35.085867 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9d470eda-e44c-4583-ac6c-7e6886448166 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:35.093491 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9d470eda-e44c-4583-ac6c-7e6886448166 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:35.094160 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9d470eda-e44c-4583-ac6c-7e6886448166 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:35.094998 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9d470eda-e44c-4583-ac6c-7e6886448166 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:35.095448 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9d470eda-e44c-4583-ac6c-7e6886448166 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:35.173008 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9d470eda-e44c-4583-ac6c-7e6886448166 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28216 microversion: 2.20 time: 0.092566 Jan 19 13:11:35.173664 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 476/946] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:35 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28216 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:35.709338 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-33e21e1a-70bd-476d-bc31-6edff826dc0c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'create', calling method: .version_select at 0x7f07e4440b80>, body: {"keypair": {"name": "tempest-keypair-1622795259"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:35.723477 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-33e21e1a-70bd-476d-bc31-6edff826dc0c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Getting quotas for project 2c0e1420e5d740a89a0d8b78be696f12. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:11:35.727750 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-33e21e1a-70bd-476d-bc31-6edff826dc0c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Getting quotas for user 4d4c420e958c47fc9a36e1602e5a2d86 and project 2c0e1420e5d740a89a0d8b78be696f12. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:11:35.963528 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-33e21e1a-70bd-476d-bc31-6edff826dc0c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Getting quotas for project 2c0e1420e5d740a89a0d8b78be696f12. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:11:35.967086 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-33e21e1a-70bd-476d-bc31-6edff826dc0c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Getting quotas for user 4d4c420e958c47fc9a36e1602e5a2d86 and project 2c0e1420e5d740a89a0d8b78be696f12. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:11:35.980276 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-33e21e1a-70bd-476d-bc31-6edff826dc0c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.274639 Jan 19 13:11:35.980868 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 471/947] 10.222.0.48 () {60 vars in 1157 bytes} [Wed Jan 19 13:11:35 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:11:36.061435 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b3f078b3-fa20-4685-8e3b-aa9f17e7eebb tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:36.062301 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b3f078b3-fa20-4685-8e3b-aa9f17e7eebb tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:36.069773 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b3f078b3-fa20-4685-8e3b-aa9f17e7eebb tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:36.070250 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b3f078b3-fa20-4685-8e3b-aa9f17e7eebb tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:36.071043 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b3f078b3-fa20-4685-8e3b-aa9f17e7eebb tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:36.071488 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b3f078b3-fa20-4685-8e3b-aa9f17e7eebb tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:36.185806 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f9c96a4f-7b9b-4c69-b93f-e36f13c5ee23 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:36.187005 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f9c96a4f-7b9b-4c69-b93f-e36f13c5ee23 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:36.194078 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9c96a4f-7b9b-4c69-b93f-e36f13c5ee23 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:36.195015 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9c96a4f-7b9b-4c69-b93f-e36f13c5ee23 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:36.196118 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9c96a4f-7b9b-4c69-b93f-e36f13c5ee23 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:36.196718 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f9c96a4f-7b9b-4c69-b93f-e36f13c5ee23 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:36.238174 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b3f078b3-fa20-4685-8e3b-aa9f17e7eebb tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:36.245856 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b3f078b3-fa20-4685-8e3b-aa9f17e7eebb tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1562 microversion: 2.1 time: 0.188668 Jan 19 13:11:36.246693 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 477/948] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:36 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1562 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:11:36.266459 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f9c96a4f-7b9b-4c69-b93f-e36f13c5ee23 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28216 microversion: 2.20 time: 0.084208 Jan 19 13:11:36.267678 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 472/949] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:36 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:11:37.276635 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1419019857", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae8f130f-fa73-4a66-ba7c-798b3f475e09"}], "security_groups": [{"name": "tempest-securitygroup--1879697151"}], "key_name": "tempest-keypair-1622795259", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:37.279936 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b43415ec-5252-4f23-b47c-88be31f3505d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:37.280967 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b43415ec-5252-4f23-b47c-88be31f3505d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:37.288185 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b43415ec-5252-4f23-b47c-88be31f3505d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:37.288766 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b43415ec-5252-4f23-b47c-88be31f3505d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:37.289549 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b43415ec-5252-4f23-b47c-88be31f3505d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:37.289992 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b43415ec-5252-4f23-b47c-88be31f3505d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:37.349724 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b43415ec-5252-4f23-b47c-88be31f3505d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28216 microversion: 2.20 time: 0.073555 Jan 19 13:11:37.350621 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 473/950] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:37 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:11:37.379541 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.network.neutron [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] validate_networks() for [('ae8f130f-fa73-4a66-ba7c-798b3f475e09', None, None, None, None, None)] {{(pid=116361) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:11:37.782315 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Flavor limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:11:37.782717 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Image limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:11:37.783182 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Flavor pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:11:37.783585 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Image pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:11:37.784010 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:11:37.793457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:37.793908 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:37.794722 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:37.795162 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:37.811065 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Getting quotas for project 2c0e1420e5d740a89a0d8b78be696f12. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:11:37.814909 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Getting quotas for user 4d4c420e958c47fc9a36e1602e5a2d86 and project 2c0e1420e5d740a89a0d8b78be696f12. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:11:37.825401 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Going to run 1 instances... {{(pid=116361) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:11:37.827683 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:11:37.878474 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-92dd7c40-0e86-469d-9563-30a28cef04b5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.606826 Jan 19 13:11:37.879112 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 478/951] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:11:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 19 13:11:37.889793 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6e239b2c-71bf-4119-9391-3abd5c28f5a3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:37.890509 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6e239b2c-71bf-4119-9391-3abd5c28f5a3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:37.948014 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6e239b2c-71bf-4119-9391-3abd5c28f5a3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:37.954587 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6e239b2c-71bf-4119-9391-3abd5c28f5a3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 200 len: 1238 microversion: 2.1 time: 0.068834 Jan 19 13:11:37.955132 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 474/952] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:37 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:11:38.361892 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e3b29c7d-11f2-4f7a-a71f-c7c64bb4dfb0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:38.362879 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e3b29c7d-11f2-4f7a-a71f-c7c64bb4dfb0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:38.369571 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3b29c7d-11f2-4f7a-a71f-c7c64bb4dfb0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:38.370021 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3b29c7d-11f2-4f7a-a71f-c7c64bb4dfb0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:38.370919 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3b29c7d-11f2-4f7a-a71f-c7c64bb4dfb0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:38.371300 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3b29c7d-11f2-4f7a-a71f-c7c64bb4dfb0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:38.440800 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e3b29c7d-11f2-4f7a-a71f-c7c64bb4dfb0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28216 microversion: 2.20 time: 0.082808 Jan 19 13:11:38.441779 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 479/953] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:38 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28216 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:38.972641 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-32b3b914-38cf-4c9d-bd9f-162d75ba2810 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:38.973432 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-32b3b914-38cf-4c9d-bd9f-162d75ba2810 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:38.978743 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-84e7bc01-4306-4d57-ae02-20b71e4a73fc req-8bef8fb9-15d9-45b6-a237-b66d64241c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ec4c20-aa67-4eef-b593-0387c00a3684", "name": "network-vif-plugged", "status": "completed", "tag": "d543cda5-e012-413e-a613-191a01247465"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:38.980399 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:11:38.980399 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:11:38.982654 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-32b3b914-38cf-4c9d-bd9f-162d75ba2810 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:38.983394 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-32b3b914-38cf-4c9d-bd9f-162d75ba2810 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:38.984437 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-32b3b914-38cf-4c9d-bd9f-162d75ba2810 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:38.984916 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-32b3b914-38cf-4c9d-bd9f-162d75ba2810 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:38.989012 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-84e7bc01-4306-4d57-ae02-20b71e4a73fc req-8bef8fb9-15d9-45b6-a237-b66d64241c4a service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:38.989469 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-84e7bc01-4306-4d57-ae02-20b71e4a73fc req-8bef8fb9-15d9-45b6-a237-b66d64241c4a service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:39.002204 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-84e7bc01-4306-4d57-ae02-20b71e4a73fc req-8bef8fb9-15d9-45b6-a237-b66d64241c4a service nova] Creating event network-vif-plugged:d543cda5-e012-413e-a613-191a01247465 for instance f7ec4c20-aa67-4eef-b593-0387c00a3684 on hv-cinder-82301 Jan 19 13:11:39.007967 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-84e7bc01-4306-4d57-ae02-20b71e4a73fc req-8bef8fb9-15d9-45b6-a237-b66d64241c4a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033849 Jan 19 13:11:39.009192 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 480/954] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:11:39.097278 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-32b3b914-38cf-4c9d-bd9f-162d75ba2810 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:39.104948 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-32b3b914-38cf-4c9d-bd9f-162d75ba2810 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 200 len: 1296 microversion: 2.1 time: 0.136702 Jan 19 13:11:39.105506 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 475/955] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:38 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 1296 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:39.453533 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4f282af6-b248-414d-9f5a-db1ed8a0759e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:39.454539 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4f282af6-b248-414d-9f5a-db1ed8a0759e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:39.461266 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f282af6-b248-414d-9f5a-db1ed8a0759e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:39.461720 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f282af6-b248-414d-9f5a-db1ed8a0759e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:39.462517 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f282af6-b248-414d-9f5a-db1ed8a0759e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:39.462958 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f282af6-b248-414d-9f5a-db1ed8a0759e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:39.525370 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4f282af6-b248-414d-9f5a-db1ed8a0759e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28216 microversion: 2.20 time: 0.075816 Jan 19 13:11:39.526042 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 481/956] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:39 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28216 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:39.784088 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d6b45c11-9144-49fa-9a56-0ad69a67344c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1235464902"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:39.784625 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d6b45c11-9144-49fa-9a56-0ad69a67344c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:39.792085 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d6b45c11-9144-49fa-9a56-0ad69a67344c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:39.792542 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d6b45c11-9144-49fa-9a56-0ad69a67344c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:39.793363 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d6b45c11-9144-49fa-9a56-0ad69a67344c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:39.793806 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d6b45c11-9144-49fa-9a56-0ad69a67344c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:40.005410 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.network.security_group_api [None req-d6b45c11-9144-49fa-9a56-0ad69a67344c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Removing security group c688c8af-f5ff-44f9-b284-30ebe35d96e7 from port 03697968-160d-4c34-bd56-d5220e2b4d4c Jan 19 13:11:40.122113 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c489dc59-771a-4f85-9b94-b6bf4d7758d2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:40.122805 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c489dc59-771a-4f85-9b94-b6bf4d7758d2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:40.131568 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c489dc59-771a-4f85-9b94-b6bf4d7758d2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:40.132080 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c489dc59-771a-4f85-9b94-b6bf4d7758d2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:40.132859 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c489dc59-771a-4f85-9b94-b6bf4d7758d2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:40.133638 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c489dc59-771a-4f85-9b94-b6bf4d7758d2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:40.419207 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-c489dc59-771a-4f85-9b94-b6bf4d7758d2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:40.426511 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c489dc59-771a-4f85-9b94-b6bf4d7758d2 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 200 len: 1364 microversion: 2.1 time: 0.309064 Jan 19 13:11:40.436272 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 482/957] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:40 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 1364 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:11:40.544302 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-568b6be4-bfe1-4f46-9d30-3672a0a68532 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:40.546249 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-568b6be4-bfe1-4f46-9d30-3672a0a68532 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:40.553097 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-568b6be4-bfe1-4f46-9d30-3672a0a68532 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:40.554526 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-568b6be4-bfe1-4f46-9d30-3672a0a68532 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:40.557168 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-568b6be4-bfe1-4f46-9d30-3672a0a68532 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:40.557622 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-568b6be4-bfe1-4f46-9d30-3672a0a68532 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:40.639404 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-568b6be4-bfe1-4f46-9d30-3672a0a68532 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28216 microversion: 2.20 time: 0.103586 Jan 19 13:11:40.640530 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 483/958] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:40 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28216 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:40.655166 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-c4a469bd-b7ed-4464-8ba9-f66e68d447d9 req-0c3a9412-e871-4520-b609-129eeb430ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "825e3e43-b49a-46d8-bc83-b84e174ae95f", "tag": "1d479fcb-0ca4-49aa-aa72-b943622b48f5"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:40.656735 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:11:40.656735 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:11:40.665015 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-c4a469bd-b7ed-4464-8ba9-f66e68d447d9 req-0c3a9412-e871-4520-b609-129eeb430ff3 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:40.665469 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-c4a469bd-b7ed-4464-8ba9-f66e68d447d9 req-0c3a9412-e871-4520-b609-129eeb430ff3 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:40.685909 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-c4a469bd-b7ed-4464-8ba9-f66e68d447d9 req-0c3a9412-e871-4520-b609-129eeb430ff3 service nova] Creating event network-changed:1d479fcb-0ca4-49aa-aa72-b943622b48f5 for instance 825e3e43-b49a-46d8-bc83-b84e174ae95f on hv-cinder-82301 Jan 19 13:11:40.696269 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d6b45c11-9144-49fa-9a56-0ad69a67344c tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "POST /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/action" status: 202 len: 0 microversion: 2.1 time: 0.915610 Jan 19 13:11:40.697171 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 476/959] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:11:39 2022] POST /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/action => generated 0 bytes in 918 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:40.698215 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-c4a469bd-b7ed-4464-8ba9-f66e68d447d9 req-0c3a9412-e871-4520-b609-129eeb430ff3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049599 Jan 19 13:11:40.699130 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 484/960] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:11:41.442491 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-fb201df0-9b51-432c-81bf-d2dac2f3bdb7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:41.443133 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-fb201df0-9b51-432c-81bf-d2dac2f3bdb7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:41.449322 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fb201df0-9b51-432c-81bf-d2dac2f3bdb7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:41.449779 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fb201df0-9b51-432c-81bf-d2dac2f3bdb7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:41.450577 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fb201df0-9b51-432c-81bf-d2dac2f3bdb7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:41.451021 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fb201df0-9b51-432c-81bf-d2dac2f3bdb7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:41.653626 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-fba75f14-b43c-426d-8fbc-b7be1ebff8db tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:41.655600 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-fba75f14-b43c-426d-8fbc-b7be1ebff8db tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:41.662205 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fba75f14-b43c-426d-8fbc-b7be1ebff8db tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:41.662886 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fba75f14-b43c-426d-8fbc-b7be1ebff8db tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:41.663882 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fba75f14-b43c-426d-8fbc-b7be1ebff8db tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:41.664715 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fba75f14-b43c-426d-8fbc-b7be1ebff8db tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:41.734361 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-fba75f14-b43c-426d-8fbc-b7be1ebff8db tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28216 microversion: 2.20 time: 0.085020 Jan 19 13:11:41.735010 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 485/961] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:41 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28216 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:11:41.936810 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-fb201df0-9b51-432c-81bf-d2dac2f3bdb7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:41.944356 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-fb201df0-9b51-432c-81bf-d2dac2f3bdb7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 200 len: 1364 microversion: 2.1 time: 0.505464 Jan 19 13:11:41.945138 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 477/962] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:41 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 1364 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:42.595594 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f7903423-7436-484a-822d-cda635249cff tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:42.596204 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f7903423-7436-484a-822d-cda635249cff tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:42.603690 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f7903423-7436-484a-822d-cda635249cff tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:42.604170 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f7903423-7436-484a-822d-cda635249cff tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:42.604948 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f7903423-7436-484a-822d-cda635249cff tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:42.605383 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f7903423-7436-484a-822d-cda635249cff tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:42.682372 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.objects.instance [None req-f7903423-7436-484a-822d-cda635249cff tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lazy-loading 'services' on Instance uuid 3d4306e3-3a88-4757-9de6-b3d2be139e7a {{(pid=116361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:11:42.720912 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-81426f18-989c-49b5-ad61-6a2514bd4c99 req-c0f2fe03-bf47-4376-9279-09a5aa5ec907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d4306e3-3a88-4757-9de6-b3d2be139e7a", "tag": "03697968-160d-4c34-bd56-d5220e2b4d4c"}, {"name": "network-changed", "server_uuid": "3d4306e3-3a88-4757-9de6-b3d2be139e7a", "tag": "03697968-160d-4c34-bd56-d5220e2b4d4c"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:42.722711 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:11:42.722711 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:11:42.730860 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-81426f18-989c-49b5-ad61-6a2514bd4c99 req-c0f2fe03-bf47-4376-9279-09a5aa5ec907 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:42.731388 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-81426f18-989c-49b5-ad61-6a2514bd4c99 req-c0f2fe03-bf47-4376-9279-09a5aa5ec907 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:42.743710 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-81426f18-989c-49b5-ad61-6a2514bd4c99 req-c0f2fe03-bf47-4376-9279-09a5aa5ec907 service nova] Creating event network-changed:03697968-160d-4c34-bd56-d5220e2b4d4c for instance 3d4306e3-3a88-4757-9de6-b3d2be139e7a on hv-cinder-82301 Jan 19 13:11:42.744438 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-81426f18-989c-49b5-ad61-6a2514bd4c99 req-c0f2fe03-bf47-4376-9279-09a5aa5ec907 service nova] Creating event network-changed:03697968-160d-4c34-bd56-d5220e2b4d4c for instance 3d4306e3-3a88-4757-9de6-b3d2be139e7a on hv-cinder-82301 Jan 19 13:11:42.749553 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-81426f18-989c-49b5-ad61-6a2514bd4c99 req-c0f2fe03-bf47-4376-9279-09a5aa5ec907 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032207 Jan 19 13:11:42.750579 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 478/963] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:11:42.756447 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-07de479f-be2a-4175-9ffa-2c21ec4040dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:42.757930 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-07de479f-be2a-4175-9ffa-2c21ec4040dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:42.764472 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-07de479f-be2a-4175-9ffa-2c21ec4040dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:42.764995 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-07de479f-be2a-4175-9ffa-2c21ec4040dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:42.765881 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-07de479f-be2a-4175-9ffa-2c21ec4040dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:42.770067 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f7903423-7436-484a-822d-cda635249cff tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/os-volume_attachments/6d66ab44-b266-4673-9d51-8cc777a55c9a" status: 202 len: 0 microversion: 2.1 time: 0.178397 Jan 19 13:11:42.770682 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 486/964] 10.222.0.48 () {58 vars in 1415 bytes} [Wed Jan 19 13:11:42 2022] DELETE /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/os-volume_attachments/6d66ab44-b266-4673-9d51-8cc777a55c9a => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:42.773058 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-07de479f-be2a-4175-9ffa-2c21ec4040dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:42.784939 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-545b897a-380f-4a44-813a-18c2d0711af9 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:42.787118 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-545b897a-380f-4a44-813a-18c2d0711af9 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:42.799837 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-545b897a-380f-4a44-813a-18c2d0711af9 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:42.800509 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-545b897a-380f-4a44-813a-18c2d0711af9 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:42.801416 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-545b897a-380f-4a44-813a-18c2d0711af9 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:42.802095 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-545b897a-380f-4a44-813a-18c2d0711af9 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:42.838450 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-545b897a-380f-4a44-813a-18c2d0711af9 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062940 Jan 19 13:11:42.839019 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 487/965] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:11:42 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:11:42.863240 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-07de479f-be2a-4175-9ffa-2c21ec4040dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28216 microversion: 2.20 time: 0.111185 Jan 19 13:11:42.864318 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 479/966] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:42 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28216 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:42.961681 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9b56aee5-1cdd-4dc5-ad62-00f5c9731e57 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:42.962495 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9b56aee5-1cdd-4dc5-ad62-00f5c9731e57 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:42.968847 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9b56aee5-1cdd-4dc5-ad62-00f5c9731e57 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:42.969386 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9b56aee5-1cdd-4dc5-ad62-00f5c9731e57 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:42.970231 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9b56aee5-1cdd-4dc5-ad62-00f5c9731e57 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:42.970736 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9b56aee5-1cdd-4dc5-ad62-00f5c9731e57 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:43.167073 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-9b56aee5-1cdd-4dc5-ad62-00f5c9731e57 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:43.175212 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9b56aee5-1cdd-4dc5-ad62-00f5c9731e57 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 200 len: 1364 microversion: 2.1 time: 0.217824 Jan 19 13:11:43.176027 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 488/967] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:42 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:43.850273 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-459b475d-c3db-4800-9272-f5d6669b98fc tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:43.851709 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-459b475d-c3db-4800-9272-f5d6669b98fc tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:43.860175 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-459b475d-c3db-4800-9272-f5d6669b98fc tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:43.860945 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-459b475d-c3db-4800-9272-f5d6669b98fc tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:43.861847 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-459b475d-c3db-4800-9272-f5d6669b98fc tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:43.862399 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-459b475d-c3db-4800-9272-f5d6669b98fc tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:43.876232 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-13ebc66c-c850-41fd-b91b-156e353c2153 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:43.877281 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-13ebc66c-c850-41fd-b91b-156e353c2153 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:43.889267 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13ebc66c-c850-41fd-b91b-156e353c2153 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:43.889835 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13ebc66c-c850-41fd-b91b-156e353c2153 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:43.890750 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13ebc66c-c850-41fd-b91b-156e353c2153 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:43.891431 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-13ebc66c-c850-41fd-b91b-156e353c2153 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:43.904185 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-459b475d-c3db-4800-9272-f5d6669b98fc tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057994 Jan 19 13:11:43.904891 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 480/968] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:11:43 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:11:43.914571 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9d635384-3d12-458c-917d-aad674db71b8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:43.915065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9d635384-3d12-458c-917d-aad674db71b8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:43.921555 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9d635384-3d12-458c-917d-aad674db71b8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:43.922015 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9d635384-3d12-458c-917d-aad674db71b8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:43.922810 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9d635384-3d12-458c-917d-aad674db71b8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:43.923249 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9d635384-3d12-458c-917d-aad674db71b8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:43.956400 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-13ebc66c-c850-41fd-b91b-156e353c2153 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28216 microversion: 2.20 time: 0.083766 Jan 19 13:11:43.957244 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 489/969] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:43 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28216 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:11:43.997905 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-9d635384-3d12-458c-917d-aad674db71b8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] HTTP exception thrown: Instance 3d4306e3-3a88-4757-9de6-b3d2be139e7a is not attached to volume 6d66ab44-b266-4673-9d51-8cc777a55c9a Jan 19 13:11:43.998540 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9d635384-3d12-458c-917d-aad674db71b8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Returning 404 to user: Instance 3d4306e3-3a88-4757-9de6-b3d2be139e7a is not attached to volume 6d66ab44-b266-4673-9d51-8cc777a55c9a {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:11:43.999443 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9d635384-3d12-458c-917d-aad674db71b8 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/os-volume_attachments/6d66ab44-b266-4673-9d51-8cc777a55c9a" status: 404 len: 154 microversion: 2.1 time: 0.088863 Jan 19 13:11:43.999998 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 481/970] 10.222.0.48 () {58 vars in 1415 bytes} [Wed Jan 19 13:11:43 2022] DELETE /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a/os-volume_attachments/6d66ab44-b266-4673-9d51-8cc777a55c9a => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 13:11:44.192411 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-227f324d-d125-4067-ba75-a28f6ad72765 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:44.193015 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-227f324d-d125-4067-ba75-a28f6ad72765 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:44.200576 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-227f324d-d125-4067-ba75-a28f6ad72765 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:44.201021 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-227f324d-d125-4067-ba75-a28f6ad72765 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:44.201790 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-227f324d-d125-4067-ba75-a28f6ad72765 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:44.202227 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-227f324d-d125-4067-ba75-a28f6ad72765 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:44.345130 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-227f324d-d125-4067-ba75-a28f6ad72765 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:44.352316 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-227f324d-d125-4067-ba75-a28f6ad72765 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 200 len: 1364 microversion: 2.1 time: 0.164033 Jan 19 13:11:44.352870 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 490/971] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:44 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:44.968179 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-08b651e3-9968-4b33-ae74-6e07650a24ee tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:44.969184 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-08b651e3-9968-4b33-ae74-6e07650a24ee tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:44.977255 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-08b651e3-9968-4b33-ae74-6e07650a24ee tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:44.977698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-08b651e3-9968-4b33-ae74-6e07650a24ee tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:44.978491 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-08b651e3-9968-4b33-ae74-6e07650a24ee tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:44.978911 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-08b651e3-9968-4b33-ae74-6e07650a24ee tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:45.057398 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-08b651e3-9968-4b33-ae74-6e07650a24ee tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28505 microversion: 2.20 time: 0.092780 Jan 19 13:11:45.058049 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 482/972] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:44 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28505 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:45.127320 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7704db23-f38f-439d-818d-10843eb0441e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:45.127814 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7704db23-f38f-439d-818d-10843eb0441e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:45.134430 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7704db23-f38f-439d-818d-10843eb0441e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:45.134875 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7704db23-f38f-439d-818d-10843eb0441e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:45.135647 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7704db23-f38f-439d-818d-10843eb0441e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:45.136104 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7704db23-f38f-439d-818d-10843eb0441e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:45.162772 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7704db23-f38f-439d-818d-10843eb0441e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Going to try to terminate instance {{(pid=116361) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:11:45.234807 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7704db23-f38f-439d-818d-10843eb0441e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 204 len: 0 microversion: 2.1 time: 0.110708 Jan 19 13:11:45.235489 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 491/973] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:11:45 2022] DELETE /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:11:45.244942 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f1e2ac24-1c0d-41a5-bb79-71cfe590280e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:45.245657 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f1e2ac24-1c0d-41a5-bb79-71cfe590280e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:45.252430 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f1e2ac24-1c0d-41a5-bb79-71cfe590280e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:45.252876 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f1e2ac24-1c0d-41a5-bb79-71cfe590280e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:45.253644 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f1e2ac24-1c0d-41a5-bb79-71cfe590280e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:45.254077 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f1e2ac24-1c0d-41a5-bb79-71cfe590280e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:45.369286 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-29d16227-c057-44c3-9ac5-351e13d7dcd9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:45.369974 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-29d16227-c057-44c3-9ac5-351e13d7dcd9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:45.376273 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-29d16227-c057-44c3-9ac5-351e13d7dcd9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:45.376737 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-29d16227-c057-44c3-9ac5-351e13d7dcd9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:45.377506 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-29d16227-c057-44c3-9ac5-351e13d7dcd9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:45.377939 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-29d16227-c057-44c3-9ac5-351e13d7dcd9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:45.387108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f1e2ac24-1c0d-41a5-bb79-71cfe590280e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:45.394547 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f1e2ac24-1c0d-41a5-bb79-71cfe590280e tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1554 microversion: 2.1 time: 0.154222 Jan 19 13:11:45.395118 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 483/974] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:45 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:45.507918 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-29d16227-c057-44c3-9ac5-351e13d7dcd9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:45.515553 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-29d16227-c057-44c3-9ac5-351e13d7dcd9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 200 len: 1364 microversion: 2.1 time: 0.150954 Jan 19 13:11:45.516158 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 492/975] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:45 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:11:46.069953 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-86bd56ac-e59d-401c-81b3-475ab8ae2fa0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:46.070877 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-86bd56ac-e59d-401c-81b3-475ab8ae2fa0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:46.077214 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-86bd56ac-e59d-401c-81b3-475ab8ae2fa0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:46.077672 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-86bd56ac-e59d-401c-81b3-475ab8ae2fa0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:46.078475 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-86bd56ac-e59d-401c-81b3-475ab8ae2fa0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:46.078917 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-86bd56ac-e59d-401c-81b3-475ab8ae2fa0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:46.231453 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-86bd56ac-e59d-401c-81b3-475ab8ae2fa0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28507 microversion: 2.20 time: 0.165648 Jan 19 13:11:46.232020 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 484/976] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:46 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:46.411690 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-06f384fe-0a81-4965-879b-270bbda9b95d tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:46.412317 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-06f384fe-0a81-4965-879b-270bbda9b95d tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:46.419020 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-06f384fe-0a81-4965-879b-270bbda9b95d tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:46.419492 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-06f384fe-0a81-4965-879b-270bbda9b95d tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:46.420300 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-06f384fe-0a81-4965-879b-270bbda9b95d tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:46.420730 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-06f384fe-0a81-4965-879b-270bbda9b95d tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:46.533239 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e0866057-697b-4bf9-a555-565640163e65 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:46.534087 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e0866057-697b-4bf9-a555-565640163e65 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:46.541818 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e0866057-697b-4bf9-a555-565640163e65 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:46.542277 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e0866057-697b-4bf9-a555-565640163e65 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:46.543065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e0866057-697b-4bf9-a555-565640163e65 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:46.543511 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e0866057-697b-4bf9-a555-565640163e65 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:46.549509 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-06f384fe-0a81-4965-879b-270bbda9b95d tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:46.557462 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-06f384fe-0a81-4965-879b-270bbda9b95d tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1554 microversion: 2.1 time: 0.149471 Jan 19 13:11:46.558030 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 493/977] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:46 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:46.672310 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-e0866057-697b-4bf9-a555-565640163e65 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:46.680173 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e0866057-697b-4bf9-a555-565640163e65 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 200 len: 1364 microversion: 2.1 time: 0.150904 Jan 19 13:11:46.680734 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 485/978] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:46 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:11:46.999822 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-5cee08c2-8a1a-4f9c-a848-b2625fc3e815 req-c40021d1-c0ce-4815-8089-20ebb7043d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825e3e43-b49a-46d8-bc83-b84e174ae95f", "name": "network-vif-plugged", "status": "completed", "tag": "1d479fcb-0ca4-49aa-aa72-b943622b48f5"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:47.001545 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:11:47.001545 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:11:47.009928 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-5cee08c2-8a1a-4f9c-a848-b2625fc3e815 req-c40021d1-c0ce-4815-8089-20ebb7043d0a service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:47.010279 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-5cee08c2-8a1a-4f9c-a848-b2625fc3e815 req-c40021d1-c0ce-4815-8089-20ebb7043d0a service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:47.021414 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-5cee08c2-8a1a-4f9c-a848-b2625fc3e815 req-c40021d1-c0ce-4815-8089-20ebb7043d0a service nova] Creating event network-vif-plugged:1d479fcb-0ca4-49aa-aa72-b943622b48f5 for instance 825e3e43-b49a-46d8-bc83-b84e174ae95f on hv-cinder-82301 Jan 19 13:11:47.027313 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-5cee08c2-8a1a-4f9c-a848-b2625fc3e815 req-c40021d1-c0ce-4815-8089-20ebb7043d0a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031141 Jan 19 13:11:47.027908 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 494/979] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:11:47.243765 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2bf8a49f-1370-4975-a0e6-308b2f1d1673 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:47.244974 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2bf8a49f-1370-4975-a0e6-308b2f1d1673 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:47.255628 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2bf8a49f-1370-4975-a0e6-308b2f1d1673 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:47.256375 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2bf8a49f-1370-4975-a0e6-308b2f1d1673 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:47.257257 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2bf8a49f-1370-4975-a0e6-308b2f1d1673 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:47.257687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2bf8a49f-1370-4975-a0e6-308b2f1d1673 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:47.543910 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2bf8a49f-1370-4975-a0e6-308b2f1d1673 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.304414 Jan 19 13:11:47.544834 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 486/980] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:47 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:47.575362 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-419c715a-68a9-4bfc-b564-c628215b9000 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:47.576085 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-419c715a-68a9-4bfc-b564-c628215b9000 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:47.582201 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-419c715a-68a9-4bfc-b564-c628215b9000 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:47.582650 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-419c715a-68a9-4bfc-b564-c628215b9000 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:47.583429 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-419c715a-68a9-4bfc-b564-c628215b9000 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:47.583864 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-419c715a-68a9-4bfc-b564-c628215b9000 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:47.697288 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e3dae7b0-4a9f-44e0-9d85-b9c50ee39e86 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:47.698016 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e3dae7b0-4a9f-44e0-9d85-b9c50ee39e86 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:47.705097 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e3dae7b0-4a9f-44e0-9d85-b9c50ee39e86 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:47.705561 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e3dae7b0-4a9f-44e0-9d85-b9c50ee39e86 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:47.706357 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e3dae7b0-4a9f-44e0-9d85-b9c50ee39e86 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:47.706802 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e3dae7b0-4a9f-44e0-9d85-b9c50ee39e86 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:47.794837 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-419c715a-68a9-4bfc-b564-c628215b9000 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72fd413268b4cf3bac09ca9f1053713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2305bfa32e0e4c0c8e01122c1d1e783c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:47.802233 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-419c715a-68a9-4bfc-b564-c628215b9000 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 200 len: 1554 microversion: 2.1 time: 0.231312 Jan 19 13:11:47.802809 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 495/981] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:47 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 1554 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:47.936507 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-e3dae7b0-4a9f-44e0-9d85-b9c50ee39e86 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:47.943813 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e3dae7b0-4a9f-44e0-9d85-b9c50ee39e86 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 200 len: 1364 microversion: 2.1 time: 0.250761 Jan 19 13:11:47.944927 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 487/982] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:47 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 1364 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:11:48.222963 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-245cf8e4-a1b1-4b45-aca6-f0225fc6422d req-881c42ea-4021-4165-8b80-aeccbff39d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4306e3-3a88-4757-9de6-b3d2be139e7a", "name": "network-vif-deleted", "tag": "03697968-160d-4c34-bd56-d5220e2b4d4c"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:48.225101 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:11:48.225101 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:11:48.234028 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-245cf8e4-a1b1-4b45-aca6-f0225fc6422d req-881c42ea-4021-4165-8b80-aeccbff39d34 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:48.234475 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-245cf8e4-a1b1-4b45-aca6-f0225fc6422d req-881c42ea-4021-4165-8b80-aeccbff39d34 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:48.245503 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-245cf8e4-a1b1-4b45-aca6-f0225fc6422d req-881c42ea-4021-4165-8b80-aeccbff39d34 service nova] Creating event network-vif-deleted:03697968-160d-4c34-bd56-d5220e2b4d4c for instance 3d4306e3-3a88-4757-9de6-b3d2be139e7a on hv-cinder-82301 Jan 19 13:11:48.250201 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-245cf8e4-a1b1-4b45-aca6-f0225fc6422d req-881c42ea-4021-4165-8b80-aeccbff39d34 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030828 Jan 19 13:11:48.250759 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 496/983] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:11:48.556088 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0af7752b-9bb1-46ba-9ff3-ef158c5f5f0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:48.557051 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0af7752b-9bb1-46ba-9ff3-ef158c5f5f0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:48.563556 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0af7752b-9bb1-46ba-9ff3-ef158c5f5f0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:48.564038 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0af7752b-9bb1-46ba-9ff3-ef158c5f5f0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:48.564838 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0af7752b-9bb1-46ba-9ff3-ef158c5f5f0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:48.565280 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0af7752b-9bb1-46ba-9ff3-ef158c5f5f0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:48.640258 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0af7752b-9bb1-46ba-9ff3-ef158c5f5f0c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.089058 Jan 19 13:11:48.641145 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 488/984] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:48 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:48.822414 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e40e4f25-c223-48e0-a9fa-e5c99660a77b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:48.823561 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e40e4f25-c223-48e0-a9fa-e5c99660a77b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] [instance: 3d4306e3-3a88-4757-9de6-b3d2be139e7a] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:48.830661 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e40e4f25-c223-48e0-a9fa-e5c99660a77b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:48.831107 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e40e4f25-c223-48e0-a9fa-e5c99660a77b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:48.831884 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e40e4f25-c223-48e0-a9fa-e5c99660a77b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:48.832342 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e40e4f25-c223-48e0-a9fa-e5c99660a77b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:48.845508 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-e40e4f25-c223-48e0-a9fa-e5c99660a77b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] HTTP exception thrown: Instance 3d4306e3-3a88-4757-9de6-b3d2be139e7a could not be found. Jan 19 13:11:48.846109 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e40e4f25-c223-48e0-a9fa-e5c99660a77b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Returning 404 to user: Instance 3d4306e3-3a88-4757-9de6-b3d2be139e7a could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:11:48.846924 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e40e4f25-c223-48e0-a9fa-e5c99660a77b tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a" status: 404 len: 111 microversion: 2.1 time: 0.031901 Jan 19 13:11:48.847462 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 497/985] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:48 2022] GET /compute/v2.1/servers/3d4306e3-3a88-4757-9de6-b3d2be139e7a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:11:48.857723 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c08186a7-9926-4662-acb6-e28d5df8b1c0 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] Calling method '.version_select at 0x7f07e44441f0>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:48.879426 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c08186a7-9926-4662-acb6-e28d5df8b1c0 tempest-TestMinimumBasicScenario-1374773274 tempest-TestMinimumBasicScenario-1374773274-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1906444010" status: 202 len: 0 microversion: 2.1 time: 0.026081 Jan 19 13:11:48.880026 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 489/986] 10.222.0.48 () {58 vars in 1271 bytes} [Wed Jan 19 13:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1906444010 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:48.961358 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-20d06d15-5eb9-4d86-9d4d-50b671d288ce tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:48.961984 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-20d06d15-5eb9-4d86-9d4d-50b671d288ce tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:48.968089 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-20d06d15-5eb9-4d86-9d4d-50b671d288ce tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:48.968556 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-20d06d15-5eb9-4d86-9d4d-50b671d288ce tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:48.969602 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-20d06d15-5eb9-4d86-9d4d-50b671d288ce tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:48.969755 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-20d06d15-5eb9-4d86-9d4d-50b671d288ce tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:49.120516 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-20d06d15-5eb9-4d86-9d4d-50b671d288ce tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:11:49.130808 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-20d06d15-5eb9-4d86-9d4d-50b671d288ce tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 200 len: 1550 microversion: 2.1 time: 0.173686 Jan 19 13:11:49.131393 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 498/987] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:11:48 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 1550 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:11:49.148217 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ff5ad8a5-79b9-4b08-9295-140076c68043 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:11:49.148822 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ff5ad8a5-79b9-4b08-9295-140076c68043 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:49.159423 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff5ad8a5-79b9-4b08-9295-140076c68043 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:49.160292 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff5ad8a5-79b9-4b08-9295-140076c68043 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:49.161064 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff5ad8a5-79b9-4b08-9295-140076c68043 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:49.161420 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff5ad8a5-79b9-4b08-9295-140076c68043 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:49.257832 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ff5ad8a5-79b9-4b08-9295-140076c68043 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114366 Jan 19 13:11:49.258682 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 490/988] 10.222.0.48 () {58 vars in 1274 bytes} [Wed Jan 19 13:11:49 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:11:49.652355 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-21b694a0-ee6e-43ca-89d1-fdc2000a0a04 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:49.654192 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-21b694a0-ee6e-43ca-89d1-fdc2000a0a04 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:49.661678 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-21b694a0-ee6e-43ca-89d1-fdc2000a0a04 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:49.662052 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-21b694a0-ee6e-43ca-89d1-fdc2000a0a04 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:49.663453 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-21b694a0-ee6e-43ca-89d1-fdc2000a0a04 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:49.664116 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-21b694a0-ee6e-43ca-89d1-fdc2000a0a04 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:49.739143 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-21b694a0-ee6e-43ca-89d1-fdc2000a0a04 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.090613 Jan 19 13:11:49.743070 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 499/989] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:49 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:50.467538 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-aa4d1910-fca9-4b82-a923-ed65520f9ce0 req-8b3df0e0-9d9a-4d83-bbca-09d669d86550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "825e3e43-b49a-46d8-bc83-b84e174ae95f", "tag": "1d479fcb-0ca4-49aa-aa72-b943622b48f5"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:50.471677 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6d5ce7c6-cd31-42ed-8860-8d72b9d125ca tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:50.475142 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6d5ce7c6-cd31-42ed-8860-8d72b9d125ca tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:50.476731 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:11:50.476731 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:11:50.488438 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-aa4d1910-fca9-4b82-a923-ed65520f9ce0 req-8b3df0e0-9d9a-4d83-bbca-09d669d86550 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:50.492576 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6d5ce7c6-cd31-42ed-8860-8d72b9d125ca tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:50.493131 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6d5ce7c6-cd31-42ed-8860-8d72b9d125ca tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:50.494003 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6d5ce7c6-cd31-42ed-8860-8d72b9d125ca tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:50.494976 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6d5ce7c6-cd31-42ed-8860-8d72b9d125ca tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:50.495410 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-aa4d1910-fca9-4b82-a923-ed65520f9ce0 req-8b3df0e0-9d9a-4d83-bbca-09d669d86550 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:50.521225 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-aa4d1910-fca9-4b82-a923-ed65520f9ce0 req-8b3df0e0-9d9a-4d83-bbca-09d669d86550 service nova] Creating event network-changed:1d479fcb-0ca4-49aa-aa72-b943622b48f5 for instance 825e3e43-b49a-46d8-bc83-b84e174ae95f on hv-cinder-82301 Jan 19 13:11:50.535379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-aa4d1910-fca9-4b82-a923-ed65520f9ce0 req-8b3df0e0-9d9a-4d83-bbca-09d669d86550 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070370 Jan 19 13:11:50.536344 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 500/990] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:11:50.569186 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6d5ce7c6-cd31-42ed-8860-8d72b9d125ca tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 14 microversion: 2.1 time: 0.109662 Jan 19 13:11:50.573108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 491/991] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:11:50 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:11:50.751127 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-dbd43a89-2d04-43a7-b913-5e48a495ec15 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:50.752459 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-dbd43a89-2d04-43a7-b913-5e48a495ec15 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:50.760124 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dbd43a89-2d04-43a7-b913-5e48a495ec15 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:50.760576 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dbd43a89-2d04-43a7-b913-5e48a495ec15 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:50.761570 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dbd43a89-2d04-43a7-b913-5e48a495ec15 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:50.762184 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dbd43a89-2d04-43a7-b913-5e48a495ec15 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:50.827789 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-dbd43a89-2d04-43a7-b913-5e48a495ec15 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.080344 Jan 19 13:11:50.828611 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 501/992] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:50 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:11:51.580765 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-24da3f36-f423-4a70-afef-06e402e223af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:51.582956 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-24da3f36-f423-4a70-afef-06e402e223af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:51.592083 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-24da3f36-f423-4a70-afef-06e402e223af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:51.593016 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-24da3f36-f423-4a70-afef-06e402e223af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:51.594302 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-24da3f36-f423-4a70-afef-06e402e223af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:51.595070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-24da3f36-f423-4a70-afef-06e402e223af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:51.665549 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-24da3f36-f423-4a70-afef-06e402e223af tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 14 microversion: 2.1 time: 0.088727 Jan 19 13:11:51.666779 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 492/993] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:11:51 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:11:51.839835 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3eb5218e-2c30-42cb-8661-662845236499 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:51.840886 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3eb5218e-2c30-42cb-8661-662845236499 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:51.847702 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3eb5218e-2c30-42cb-8661-662845236499 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:51.848127 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3eb5218e-2c30-42cb-8661-662845236499 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:51.848905 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3eb5218e-2c30-42cb-8661-662845236499 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:51.849333 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3eb5218e-2c30-42cb-8661-662845236499 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:51.915764 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3eb5218e-2c30-42cb-8661-662845236499 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.080322 Jan 19 13:11:51.921006 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 502/994] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:51 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:52.678005 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-50521758-5daa-4b92-aa26-dbdf59bbde6b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:52.679367 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-50521758-5daa-4b92-aa26-dbdf59bbde6b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:52.686504 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50521758-5daa-4b92-aa26-dbdf59bbde6b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:52.687247 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50521758-5daa-4b92-aa26-dbdf59bbde6b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:52.688257 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50521758-5daa-4b92-aa26-dbdf59bbde6b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:52.689119 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-50521758-5daa-4b92-aa26-dbdf59bbde6b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:52.757520 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-50521758-5daa-4b92-aa26-dbdf59bbde6b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 14 microversion: 2.1 time: 0.082828 Jan 19 13:11:52.758544 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 493/995] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:11:52 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:11:52.928051 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-dbec1154-326c-4004-8f79-48105458e200 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:52.929211 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-dbec1154-326c-4004-8f79-48105458e200 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:52.939159 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dbec1154-326c-4004-8f79-48105458e200 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:52.939614 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dbec1154-326c-4004-8f79-48105458e200 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:52.940447 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dbec1154-326c-4004-8f79-48105458e200 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:52.940890 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dbec1154-326c-4004-8f79-48105458e200 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:53.012611 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-dbec1154-326c-4004-8f79-48105458e200 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.088480 Jan 19 13:11:53.016220 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 503/996] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:52 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:53.770123 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b988c8cf-8a74-4040-b430-159085ca560d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:53.772643 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b988c8cf-8a74-4040-b430-159085ca560d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:53.782873 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b988c8cf-8a74-4040-b430-159085ca560d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:53.783711 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b988c8cf-8a74-4040-b430-159085ca560d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:53.784807 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b988c8cf-8a74-4040-b430-159085ca560d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:53.785460 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b988c8cf-8a74-4040-b430-159085ca560d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:53.861942 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b988c8cf-8a74-4040-b430-159085ca560d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 14 microversion: 2.1 time: 0.096447 Jan 19 13:11:53.863203 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 494/997] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:11:53 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:11:54.025092 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-65c9bfe9-3249-4519-a640-17b34711269f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:54.026022 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-65c9bfe9-3249-4519-a640-17b34711269f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:54.033032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-65c9bfe9-3249-4519-a640-17b34711269f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:54.033554 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-65c9bfe9-3249-4519-a640-17b34711269f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:54.034356 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-65c9bfe9-3249-4519-a640-17b34711269f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:54.034802 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-65c9bfe9-3249-4519-a640-17b34711269f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:54.099809 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-65c9bfe9-3249-4519-a640-17b34711269f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.078982 Jan 19 13:11:54.104229 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 504/998] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:54 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:54.873887 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-1084ad93-ab09-44f3-b614-36b05fca8173 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:54.874915 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-1084ad93-ab09-44f3-b614-36b05fca8173 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:54.882375 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1084ad93-ab09-44f3-b614-36b05fca8173 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:54.882827 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1084ad93-ab09-44f3-b614-36b05fca8173 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:54.883908 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1084ad93-ab09-44f3-b614-36b05fca8173 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:54.884374 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1084ad93-ab09-44f3-b614-36b05fca8173 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:54.945888 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-1084ad93-ab09-44f3-b614-36b05fca8173 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 14 microversion: 2.1 time: 0.075880 Jan 19 13:11:54.949166 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 495/999] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:11:54 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:11:55.114290 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a92bdc7f-c4d7-4791-9bc7-64899a9cd58a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:55.115494 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a92bdc7f-c4d7-4791-9bc7-64899a9cd58a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:55.123644 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a92bdc7f-c4d7-4791-9bc7-64899a9cd58a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:55.124205 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a92bdc7f-c4d7-4791-9bc7-64899a9cd58a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:55.125071 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a92bdc7f-c4d7-4791-9bc7-64899a9cd58a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:55.125597 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a92bdc7f-c4d7-4791-9bc7-64899a9cd58a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:55.187362 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a92bdc7f-c4d7-4791-9bc7-64899a9cd58a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.078412 Jan 19 13:11:55.188039 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 505/1000] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:55 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:55.961492 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0ab2cbcd-145a-4329-802d-cc81526ec4f6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:55.962514 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0ab2cbcd-145a-4329-802d-cc81526ec4f6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:55.969374 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ab2cbcd-145a-4329-802d-cc81526ec4f6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:55.969822 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ab2cbcd-145a-4329-802d-cc81526ec4f6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:55.970598 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ab2cbcd-145a-4329-802d-cc81526ec4f6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:55.971035 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0ab2cbcd-145a-4329-802d-cc81526ec4f6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:56.036523 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0ab2cbcd-145a-4329-802d-cc81526ec4f6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 14 microversion: 2.1 time: 0.082353 Jan 19 13:11:56.040373 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 496/1001] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:11:55 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 13:11:56.200254 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1159d355-31a2-40d8-b00a-1e722303b626 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:56.201284 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1159d355-31a2-40d8-b00a-1e722303b626 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:56.208269 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1159d355-31a2-40d8-b00a-1e722303b626 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:56.209023 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1159d355-31a2-40d8-b00a-1e722303b626 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:56.209836 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1159d355-31a2-40d8-b00a-1e722303b626 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:56.210284 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1159d355-31a2-40d8-b00a-1e722303b626 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:56.280651 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1159d355-31a2-40d8-b00a-1e722303b626 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.084238 Jan 19 13:11:56.281783 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 506/1002] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:56 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:57.047471 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c68079c3-26ba-4e22-a554-1bd6b43e8ccf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:57.048632 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c68079c3-26ba-4e22-a554-1bd6b43e8ccf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:57.056726 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c68079c3-26ba-4e22-a554-1bd6b43e8ccf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:57.057175 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c68079c3-26ba-4e22-a554-1bd6b43e8ccf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:57.057988 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c68079c3-26ba-4e22-a554-1bd6b43e8ccf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:57.058411 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c68079c3-26ba-4e22-a554-1bd6b43e8ccf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:57.119801 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c68079c3-26ba-4e22-a554-1bd6b43e8ccf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 14 microversion: 2.1 time: 0.076201 Jan 19 13:11:57.123558 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 497/1003] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:11:57 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:11:57.293726 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ae748d80-0e89-46a7-89de-e6aa61c57d1b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:57.294722 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ae748d80-0e89-46a7-89de-e6aa61c57d1b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:57.302026 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ae748d80-0e89-46a7-89de-e6aa61c57d1b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:57.302483 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ae748d80-0e89-46a7-89de-e6aa61c57d1b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:57.303398 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ae748d80-0e89-46a7-89de-e6aa61c57d1b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:57.303887 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ae748d80-0e89-46a7-89de-e6aa61c57d1b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:57.366088 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ae748d80-0e89-46a7-89de-e6aa61c57d1b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.075943 Jan 19 13:11:57.366959 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 507/1004] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:57 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:58.132440 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3ef6c8a7-7744-473c-baf3-5635f971cd71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:58.133719 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3ef6c8a7-7744-473c-baf3-5635f971cd71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:58.140494 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3ef6c8a7-7744-473c-baf3-5635f971cd71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:58.140948 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3ef6c8a7-7744-473c-baf3-5635f971cd71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:58.141714 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3ef6c8a7-7744-473c-baf3-5635f971cd71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:58.142146 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3ef6c8a7-7744-473c-baf3-5635f971cd71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:58.201690 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3ef6c8a7-7744-473c-baf3-5635f971cd71 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 14 microversion: 2.1 time: 0.073848 Jan 19 13:11:58.202285 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 498/1005] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:11:58 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:11:58.378293 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-311620b8-14ea-434c-916e-0e9025b36188 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:58.379301 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-311620b8-14ea-434c-916e-0e9025b36188 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:58.386652 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-311620b8-14ea-434c-916e-0e9025b36188 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:58.387052 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-311620b8-14ea-434c-916e-0e9025b36188 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:58.387830 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-311620b8-14ea-434c-916e-0e9025b36188 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:58.388302 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-311620b8-14ea-434c-916e-0e9025b36188 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:58.450117 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-311620b8-14ea-434c-916e-0e9025b36188 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.075811 Jan 19 13:11:58.450747 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 508/1006] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:58 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:11:59.214157 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-109c4dcd-ef28-4ae3-be94-aabe025a97e9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:59.215113 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-109c4dcd-ef28-4ae3-be94-aabe025a97e9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:59.221952 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-109c4dcd-ef28-4ae3-be94-aabe025a97e9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:59.222404 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-109c4dcd-ef28-4ae3-be94-aabe025a97e9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:59.223177 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-109c4dcd-ef28-4ae3-be94-aabe025a97e9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:59.223617 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-109c4dcd-ef28-4ae3-be94-aabe025a97e9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:59.292580 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-109c4dcd-ef28-4ae3-be94-aabe025a97e9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 14 microversion: 2.1 time: 0.083210 Jan 19 13:11:59.293376 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 499/1007] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:11:59 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:11:59.466440 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-893472f5-3589-4510-8b6f-38759aa5a53d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:11:59.467363 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-893472f5-3589-4510-8b6f-38759aa5a53d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:11:59.474241 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-893472f5-3589-4510-8b6f-38759aa5a53d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:59.474690 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-893472f5-3589-4510-8b6f-38759aa5a53d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:59.475938 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-893472f5-3589-4510-8b6f-38759aa5a53d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:11:59.476407 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-893472f5-3589-4510-8b6f-38759aa5a53d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:11:59.545916 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-893472f5-3589-4510-8b6f-38759aa5a53d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.087448 Jan 19 13:11:59.546550 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 509/1008] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:11:59 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:00.303108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6def031f-2873-4f97-963b-5d2931b3eae6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:00.304218 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6def031f-2873-4f97-963b-5d2931b3eae6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:00.310987 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6def031f-2873-4f97-963b-5d2931b3eae6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:00.311433 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6def031f-2873-4f97-963b-5d2931b3eae6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:00.312228 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6def031f-2873-4f97-963b-5d2931b3eae6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:00.312663 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6def031f-2873-4f97-963b-5d2931b3eae6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:00.377452 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6def031f-2873-4f97-963b-5d2931b3eae6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 14 microversion: 2.1 time: 0.078230 Jan 19 13:12:00.378047 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 500/1009] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:00 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:12:00.558428 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c8f76486-14f2-43d1-9913-4ae55067caeb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:00.559482 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c8f76486-14f2-43d1-9913-4ae55067caeb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:00.566397 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c8f76486-14f2-43d1-9913-4ae55067caeb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:00.566851 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c8f76486-14f2-43d1-9913-4ae55067caeb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:00.567629 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c8f76486-14f2-43d1-9913-4ae55067caeb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:00.568097 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c8f76486-14f2-43d1-9913-4ae55067caeb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:00.630961 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c8f76486-14f2-43d1-9913-4ae55067caeb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.076596 Jan 19 13:12:00.632158 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 510/1010] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:00 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:01.389067 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-8d63e5df-06a3-4ed5-b9bd-6cf8f3c32951 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:01.390074 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-8d63e5df-06a3-4ed5-b9bd-6cf8f3c32951 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:01.397099 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8d63e5df-06a3-4ed5-b9bd-6cf8f3c32951 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:01.397665 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8d63e5df-06a3-4ed5-b9bd-6cf8f3c32951 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:01.398451 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8d63e5df-06a3-4ed5-b9bd-6cf8f3c32951 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:01.398892 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8d63e5df-06a3-4ed5-b9bd-6cf8f3c32951 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:01.469902 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-8d63e5df-06a3-4ed5-b9bd-6cf8f3c32951 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 14 microversion: 2.1 time: 0.084716 Jan 19 13:12:01.470521 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 501/1011] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:01 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:12:01.644033 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-57ea6841-d424-48eb-bce9-bdf43990ac6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:01.644967 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-57ea6841-d424-48eb-bce9-bdf43990ac6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:01.652411 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-57ea6841-d424-48eb-bce9-bdf43990ac6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:01.652870 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-57ea6841-d424-48eb-bce9-bdf43990ac6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:01.653657 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-57ea6841-d424-48eb-bce9-bdf43990ac6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:01.654100 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-57ea6841-d424-48eb-bce9-bdf43990ac6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:01.727719 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-57ea6841-d424-48eb-bce9-bdf43990ac6e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.087752 Jan 19 13:12:01.728654 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 511/1012] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:01 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:02.481992 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d13f12c0-8346-400d-b87d-72873b91f909 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:02.482993 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d13f12c0-8346-400d-b87d-72873b91f909 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:02.489935 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d13f12c0-8346-400d-b87d-72873b91f909 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:02.490429 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d13f12c0-8346-400d-b87d-72873b91f909 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:02.491271 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d13f12c0-8346-400d-b87d-72873b91f909 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:02.491715 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d13f12c0-8346-400d-b87d-72873b91f909 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:02.567471 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d13f12c0-8346-400d-b87d-72873b91f909 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 10893 microversion: 2.1 time: 0.089381 Jan 19 13:12:02.568038 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 502/1013] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:02 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 10893 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:02.739216 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-245a6234-09a8-4781-9e32-f4ac2c616d14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:02.740280 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-245a6234-09a8-4781-9e32-f4ac2c616d14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:02.747416 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-245a6234-09a8-4781-9e32-f4ac2c616d14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:02.747872 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-245a6234-09a8-4781-9e32-f4ac2c616d14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:02.748687 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-245a6234-09a8-4781-9e32-f4ac2c616d14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:02.749130 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-245a6234-09a8-4781-9e32-f4ac2c616d14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:02.814144 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-245a6234-09a8-4781-9e32-f4ac2c616d14 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.078905 Jan 19 13:12:02.814782 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 512/1014] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:02 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:12:03.578987 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-fc78d6d4-0e99-4fcb-874e-68c252b4bf3c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:03.580027 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-fc78d6d4-0e99-4fcb-874e-68c252b4bf3c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:03.586956 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fc78d6d4-0e99-4fcb-874e-68c252b4bf3c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:03.587418 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fc78d6d4-0e99-4fcb-874e-68c252b4bf3c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:03.588237 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fc78d6d4-0e99-4fcb-874e-68c252b4bf3c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:03.588678 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fc78d6d4-0e99-4fcb-874e-68c252b4bf3c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:03.656977 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-fc78d6d4-0e99-4fcb-874e-68c252b4bf3c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 17629 microversion: 2.1 time: 0.081958 Jan 19 13:12:03.657593 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 503/1015] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:03 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 17629 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:03.826140 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9d071a14-5b23-44a4-8512-a376493aad8b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:03.827175 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9d071a14-5b23-44a4-8512-a376493aad8b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:03.834099 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9d071a14-5b23-44a4-8512-a376493aad8b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:03.834524 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9d071a14-5b23-44a4-8512-a376493aad8b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:03.835314 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9d071a14-5b23-44a4-8512-a376493aad8b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:03.835753 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9d071a14-5b23-44a4-8512-a376493aad8b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:03.900162 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9d071a14-5b23-44a4-8512-a376493aad8b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.077943 Jan 19 13:12:03.901084 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 513/1016] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:03 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:04.669092 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0321176d-01ba-4b7f-b2c9-a41cd1bb2c46 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:04.670103 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0321176d-01ba-4b7f-b2c9-a41cd1bb2c46 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:04.676968 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0321176d-01ba-4b7f-b2c9-a41cd1bb2c46 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:04.677426 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0321176d-01ba-4b7f-b2c9-a41cd1bb2c46 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:04.678809 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0321176d-01ba-4b7f-b2c9-a41cd1bb2c46 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:04.679278 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0321176d-01ba-4b7f-b2c9-a41cd1bb2c46 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:04.759461 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0321176d-01ba-4b7f-b2c9-a41cd1bb2c46 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 18356 microversion: 2.1 time: 0.094266 Jan 19 13:12:04.760123 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 504/1017] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:04 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 18356 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:04.911564 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3b628c15-dcda-4133-97a7-c1b1aa42095c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:04.913224 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3b628c15-dcda-4133-97a7-c1b1aa42095c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:04.920038 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b628c15-dcda-4133-97a7-c1b1aa42095c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:04.920453 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b628c15-dcda-4133-97a7-c1b1aa42095c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:04.921223 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b628c15-dcda-4133-97a7-c1b1aa42095c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:04.921658 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b628c15-dcda-4133-97a7-c1b1aa42095c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:04.994805 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3b628c15-dcda-4133-97a7-c1b1aa42095c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.087197 Jan 19 13:12:04.995494 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 514/1018] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:04 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:05.770506 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-736c0c0c-58e9-4765-93af-0c77a0f28427 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:05.771622 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-736c0c0c-58e9-4765-93af-0c77a0f28427 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:05.778577 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-736c0c0c-58e9-4765-93af-0c77a0f28427 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:05.779026 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-736c0c0c-58e9-4765-93af-0c77a0f28427 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:05.779798 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-736c0c0c-58e9-4765-93af-0c77a0f28427 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:05.780360 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-736c0c0c-58e9-4765-93af-0c77a0f28427 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:05.858408 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-736c0c0c-58e9-4765-93af-0c77a0f28427 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 21165 microversion: 2.1 time: 0.091882 Jan 19 13:12:05.859113 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 505/1019] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:05 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 21165 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:06.007003 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6d1249e4-c984-4909-a6b1-85381430aa71 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:06.008291 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6d1249e4-c984-4909-a6b1-85381430aa71 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:06.015388 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d1249e4-c984-4909-a6b1-85381430aa71 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:06.015843 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d1249e4-c984-4909-a6b1-85381430aa71 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:06.016667 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d1249e4-c984-4909-a6b1-85381430aa71 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:06.017111 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6d1249e4-c984-4909-a6b1-85381430aa71 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:06.079659 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6d1249e4-c984-4909-a6b1-85381430aa71 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.076625 Jan 19 13:12:06.080261 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 515/1020] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:06 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:06.871112 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-1c7ae466-b7de-465c-a01c-abdd142b55c9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:06.872093 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-1c7ae466-b7de-465c-a01c-abdd142b55c9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:06.879002 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1c7ae466-b7de-465c-a01c-abdd142b55c9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:06.879488 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1c7ae466-b7de-465c-a01c-abdd142b55c9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:06.880311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1c7ae466-b7de-465c-a01c-abdd142b55c9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:06.880795 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1c7ae466-b7de-465c-a01c-abdd142b55c9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:06.950742 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-1c7ae466-b7de-465c-a01c-abdd142b55c9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 23043 microversion: 2.1 time: 0.083669 Jan 19 13:12:06.951366 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 506/1021] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:06 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 23043 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:07.091144 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-329ad073-be73-4eb2-8ca0-0627d3221f86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:07.092164 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-329ad073-be73-4eb2-8ca0-0627d3221f86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:07.098934 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-329ad073-be73-4eb2-8ca0-0627d3221f86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:07.104914 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-329ad073-be73-4eb2-8ca0-0627d3221f86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:07.105702 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-329ad073-be73-4eb2-8ca0-0627d3221f86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:07.106140 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-329ad073-be73-4eb2-8ca0-0627d3221f86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:07.171883 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-329ad073-be73-4eb2-8ca0-0627d3221f86 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.084610 Jan 19 13:12:07.172483 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 516/1022] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:07 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:07.963460 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5d278cb7-5c2d-4a59-a50b-e1ed52ed2e69 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:07.964518 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5d278cb7-5c2d-4a59-a50b-e1ed52ed2e69 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:07.971627 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5d278cb7-5c2d-4a59-a50b-e1ed52ed2e69 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:07.972104 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5d278cb7-5c2d-4a59-a50b-e1ed52ed2e69 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:07.972889 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5d278cb7-5c2d-4a59-a50b-e1ed52ed2e69 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:07.973328 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5d278cb7-5c2d-4a59-a50b-e1ed52ed2e69 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:08.043745 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5d278cb7-5c2d-4a59-a50b-e1ed52ed2e69 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 24369 microversion: 2.1 time: 0.084677 Jan 19 13:12:08.044435 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 507/1023] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:07 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 24369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:08.183968 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0611ea2a-ef93-4b03-a433-ae974588ea97 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:08.184945 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0611ea2a-ef93-4b03-a433-ae974588ea97 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:08.191803 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0611ea2a-ef93-4b03-a433-ae974588ea97 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:08.192293 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0611ea2a-ef93-4b03-a433-ae974588ea97 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:08.193071 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0611ea2a-ef93-4b03-a433-ae974588ea97 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:08.194035 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0611ea2a-ef93-4b03-a433-ae974588ea97 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:08.256378 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0611ea2a-ef93-4b03-a433-ae974588ea97 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.075965 Jan 19 13:12:08.257016 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 517/1024] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:08 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:09.056951 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3e1311e5-622f-4a2f-9270-c80afa3376ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:09.057944 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3e1311e5-622f-4a2f-9270-c80afa3376ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:09.064810 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3e1311e5-622f-4a2f-9270-c80afa3376ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:09.065266 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3e1311e5-622f-4a2f-9270-c80afa3376ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:09.066052 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3e1311e5-622f-4a2f-9270-c80afa3376ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:09.066497 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3e1311e5-622f-4a2f-9270-c80afa3376ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:09.134611 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3e1311e5-622f-4a2f-9270-c80afa3376ed tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 25892 microversion: 2.1 time: 0.082404 Jan 19 13:12:09.135162 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 508/1025] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:09 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 25892 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:12:09.267900 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-77db4ad1-e0e0-4430-85f6-d409970757a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:09.269032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-77db4ad1-e0e0-4430-85f6-d409970757a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:09.276707 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-77db4ad1-e0e0-4430-85f6-d409970757a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:09.277165 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-77db4ad1-e0e0-4430-85f6-d409970757a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:09.277946 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-77db4ad1-e0e0-4430-85f6-d409970757a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:09.278391 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-77db4ad1-e0e0-4430-85f6-d409970757a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:09.340454 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-77db4ad1-e0e0-4430-85f6-d409970757a2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.076432 Jan 19 13:12:09.341163 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 518/1026] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:09 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:10.147090 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-596da396-d9dd-401d-95b3-def4424b7061 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:10.148021 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-596da396-d9dd-401d-95b3-def4424b7061 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:10.154819 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-596da396-d9dd-401d-95b3-def4424b7061 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:10.155292 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-596da396-d9dd-401d-95b3-def4424b7061 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:10.156078 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-596da396-d9dd-401d-95b3-def4424b7061 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:10.156511 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-596da396-d9dd-401d-95b3-def4424b7061 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:10.233025 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-596da396-d9dd-401d-95b3-def4424b7061 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 27132 microversion: 2.1 time: 0.090455 Jan 19 13:12:10.233648 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 509/1027] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:10 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 27132 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:10.352559 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-903a96f3-8ffa-4eb4-ab0e-c1169523f1cc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:10.353551 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-903a96f3-8ffa-4eb4-ab0e-c1169523f1cc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:10.360377 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-903a96f3-8ffa-4eb4-ab0e-c1169523f1cc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:10.360823 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-903a96f3-8ffa-4eb4-ab0e-c1169523f1cc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:10.361587 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-903a96f3-8ffa-4eb4-ab0e-c1169523f1cc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:10.362020 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-903a96f3-8ffa-4eb4-ab0e-c1169523f1cc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:10.428473 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-903a96f3-8ffa-4eb4-ab0e-c1169523f1cc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.079830 Jan 19 13:12:10.429025 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 519/1028] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:10 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:11.245300 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-940c1416-453b-44b6-a4ed-179df00c95db tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:11.246347 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-940c1416-453b-44b6-a4ed-179df00c95db tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:11.253848 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-940c1416-453b-44b6-a4ed-179df00c95db tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:11.254298 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-940c1416-453b-44b6-a4ed-179df00c95db tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:11.255074 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-940c1416-453b-44b6-a4ed-179df00c95db tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:11.255515 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-940c1416-453b-44b6-a4ed-179df00c95db tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:11.333762 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-940c1416-453b-44b6-a4ed-179df00c95db tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 27744 microversion: 2.1 time: 0.092443 Jan 19 13:12:11.334384 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 510/1029] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:11 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 27744 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:11.440362 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-66adf5c3-907f-4fc8-8c00-8c707e8074fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:11.441394 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-66adf5c3-907f-4fc8-8c00-8c707e8074fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:11.449341 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-66adf5c3-907f-4fc8-8c00-8c707e8074fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:11.449797 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-66adf5c3-907f-4fc8-8c00-8c707e8074fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:11.450589 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-66adf5c3-907f-4fc8-8c00-8c707e8074fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:11.451032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-66adf5c3-907f-4fc8-8c00-8c707e8074fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:11.519846 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-66adf5c3-907f-4fc8-8c00-8c707e8074fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.083354 Jan 19 13:12:11.520429 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 520/1030] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:11 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:12:12.345971 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-1b1bdfc1-533c-4951-a468-7396915008f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:12.346986 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-1b1bdfc1-533c-4951-a468-7396915008f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:12.353950 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1b1bdfc1-533c-4951-a468-7396915008f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:12.354406 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1b1bdfc1-533c-4951-a468-7396915008f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:12.355187 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1b1bdfc1-533c-4951-a468-7396915008f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:12.355627 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1b1bdfc1-533c-4951-a468-7396915008f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:12.435579 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-1b1bdfc1-533c-4951-a468-7396915008f0 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28188 microversion: 2.1 time: 0.093518 Jan 19 13:12:12.436394 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 511/1031] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:12 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:12.532586 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1e47052d-0fe6-4ec9-917e-c1a6d8762f73 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:12.533518 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1e47052d-0fe6-4ec9-917e-c1a6d8762f73 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:12.541094 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1e47052d-0fe6-4ec9-917e-c1a6d8762f73 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:12.541551 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1e47052d-0fe6-4ec9-917e-c1a6d8762f73 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:12.542485 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1e47052d-0fe6-4ec9-917e-c1a6d8762f73 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:12.543151 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1e47052d-0fe6-4ec9-917e-c1a6d8762f73 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:12.606226 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1e47052d-0fe6-4ec9-917e-c1a6d8762f73 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.077726 Jan 19 13:12:12.607131 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 521/1032] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:12 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:13.447770 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3b2cbf03-0a26-424d-ad5b-09cc6344b905 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:13.448807 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3b2cbf03-0a26-424d-ad5b-09cc6344b905 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:13.455705 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3b2cbf03-0a26-424d-ad5b-09cc6344b905 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:13.456194 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3b2cbf03-0a26-424d-ad5b-09cc6344b905 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:13.456977 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3b2cbf03-0a26-424d-ad5b-09cc6344b905 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:13.457421 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3b2cbf03-0a26-424d-ad5b-09cc6344b905 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:13.528478 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3b2cbf03-0a26-424d-ad5b-09cc6344b905 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28233 microversion: 2.1 time: 0.085125 Jan 19 13:12:13.529097 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 512/1033] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:13 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28233 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:13.618908 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2652ecc2-688a-4138-87ed-5a9e1f263ee3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:13.619943 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2652ecc2-688a-4138-87ed-5a9e1f263ee3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:13.626989 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2652ecc2-688a-4138-87ed-5a9e1f263ee3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:13.627446 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2652ecc2-688a-4138-87ed-5a9e1f263ee3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:13.628269 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2652ecc2-688a-4138-87ed-5a9e1f263ee3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:13.628708 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2652ecc2-688a-4138-87ed-5a9e1f263ee3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:13.702801 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2652ecc2-688a-4138-87ed-5a9e1f263ee3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 28674 microversion: 2.20 time: 0.088462 Jan 19 13:12:13.703352 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 522/1034] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:13 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 28674 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:14.541829 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c55ffd7b-9bab-4516-9fe5-b623fd1baddf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:14.542776 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c55ffd7b-9bab-4516-9fe5-b623fd1baddf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:14.549712 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c55ffd7b-9bab-4516-9fe5-b623fd1baddf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:14.550167 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c55ffd7b-9bab-4516-9fe5-b623fd1baddf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:14.550955 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c55ffd7b-9bab-4516-9fe5-b623fd1baddf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:14.551398 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c55ffd7b-9bab-4516-9fe5-b623fd1baddf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:14.610617 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c55ffd7b-9bab-4516-9fe5-b623fd1baddf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28233 microversion: 2.1 time: 0.073550 Jan 19 13:12:14.611352 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 513/1035] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:14 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28233 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:12:14.715441 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1338a54f-62a0-4af6-933c-7640abc3cc03 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:14.716470 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1338a54f-62a0-4af6-933c-7640abc3cc03 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:14.723419 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1338a54f-62a0-4af6-933c-7640abc3cc03 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:14.723870 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1338a54f-62a0-4af6-933c-7640abc3cc03 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:14.725257 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1338a54f-62a0-4af6-933c-7640abc3cc03 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:14.725702 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1338a54f-62a0-4af6-933c-7640abc3cc03 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:14.802695 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1338a54f-62a0-4af6-933c-7640abc3cc03 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 29607 microversion: 2.20 time: 0.091175 Jan 19 13:12:14.803273 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 523/1036] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:14 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 29607 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:15.623163 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-245c6723-32bd-47d1-894f-3362eeb1d082 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:15.624219 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-245c6723-32bd-47d1-894f-3362eeb1d082 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:15.631079 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-245c6723-32bd-47d1-894f-3362eeb1d082 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:15.631560 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-245c6723-32bd-47d1-894f-3362eeb1d082 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:15.632364 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-245c6723-32bd-47d1-894f-3362eeb1d082 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:15.632829 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-245c6723-32bd-47d1-894f-3362eeb1d082 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:15.696825 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-245c6723-32bd-47d1-894f-3362eeb1d082 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28233 microversion: 2.1 time: 0.077477 Jan 19 13:12:15.697472 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 514/1037] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:15 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28233 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:15.814145 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b80136ae-ca02-45ec-bd98-e99f3641d5dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:15.815143 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b80136ae-ca02-45ec-bd98-e99f3641d5dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:15.822144 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b80136ae-ca02-45ec-bd98-e99f3641d5dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:15.822590 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b80136ae-ca02-45ec-bd98-e99f3641d5dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:15.823357 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b80136ae-ca02-45ec-bd98-e99f3641d5dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:15.823788 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b80136ae-ca02-45ec-bd98-e99f3641d5dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:15.901320 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b80136ae-ca02-45ec-bd98-e99f3641d5dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 31509 microversion: 2.20 time: 0.091019 Jan 19 13:12:15.901942 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 524/1038] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:15 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 31509 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 13:12:16.708510 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b91f0c3a-48ca-49c2-9be6-df8d958339c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:16.709515 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b91f0c3a-48ca-49c2-9be6-df8d958339c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:16.716864 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b91f0c3a-48ca-49c2-9be6-df8d958339c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:16.717318 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b91f0c3a-48ca-49c2-9be6-df8d958339c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:16.718089 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b91f0c3a-48ca-49c2-9be6-df8d958339c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:16.718526 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b91f0c3a-48ca-49c2-9be6-df8d958339c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:16.778079 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b91f0c3a-48ca-49c2-9be6-df8d958339c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28233 microversion: 2.1 time: 0.073563 Jan 19 13:12:16.778713 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 515/1039] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:16 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28233 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:16.913824 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-32e2d3c5-0441-4ff5-98b2-cbdd4215a691 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:16.914831 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-32e2d3c5-0441-4ff5-98b2-cbdd4215a691 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:16.921722 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32e2d3c5-0441-4ff5-98b2-cbdd4215a691 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:16.922175 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32e2d3c5-0441-4ff5-98b2-cbdd4215a691 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:16.922952 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32e2d3c5-0441-4ff5-98b2-cbdd4215a691 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:16.923387 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-32e2d3c5-0441-4ff5-98b2-cbdd4215a691 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:16.996422 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-32e2d3c5-0441-4ff5-98b2-cbdd4215a691 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 32755 microversion: 2.20 time: 0.086831 Jan 19 13:12:16.997233 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 525/1040] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:16 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 32755 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:17.791041 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-898425b1-b64a-49c6-ac44-4a0fd993d976 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:17.792070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-898425b1-b64a-49c6-ac44-4a0fd993d976 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:17.798995 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-898425b1-b64a-49c6-ac44-4a0fd993d976 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:17.799447 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-898425b1-b64a-49c6-ac44-4a0fd993d976 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:17.800289 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-898425b1-b64a-49c6-ac44-4a0fd993d976 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:17.800731 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-898425b1-b64a-49c6-ac44-4a0fd993d976 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:17.861996 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-898425b1-b64a-49c6-ac44-4a0fd993d976 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28233 microversion: 2.1 time: 0.075691 Jan 19 13:12:17.862668 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 516/1041] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:17 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28233 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:18.008646 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-edd9443e-44ca-43e8-b4ea-296306a1819c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:18.009669 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-edd9443e-44ca-43e8-b4ea-296306a1819c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:18.016459 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-edd9443e-44ca-43e8-b4ea-296306a1819c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:18.016905 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-edd9443e-44ca-43e8-b4ea-296306a1819c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:18.017676 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-edd9443e-44ca-43e8-b4ea-296306a1819c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:18.018114 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-edd9443e-44ca-43e8-b4ea-296306a1819c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:18.090019 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-edd9443e-44ca-43e8-b4ea-296306a1819c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 33766 microversion: 2.20 time: 0.086154 Jan 19 13:12:18.090648 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 526/1042] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:18 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 33766 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:18.873211 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-fe86f6dc-ed7d-409b-b41a-55eca951e0dc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:18.874224 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-fe86f6dc-ed7d-409b-b41a-55eca951e0dc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:18.881167 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fe86f6dc-ed7d-409b-b41a-55eca951e0dc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:18.881689 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fe86f6dc-ed7d-409b-b41a-55eca951e0dc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:18.882525 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fe86f6dc-ed7d-409b-b41a-55eca951e0dc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:18.883225 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fe86f6dc-ed7d-409b-b41a-55eca951e0dc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:18.948032 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-fe86f6dc-ed7d-409b-b41a-55eca951e0dc tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28233 microversion: 2.1 time: 0.078694 Jan 19 13:12:18.948661 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 517/1043] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:18 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28233 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:19.103157 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3854605b-9a70-4859-b339-b273cbbeb007 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:19.104209 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3854605b-9a70-4859-b339-b273cbbeb007 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:19.111182 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3854605b-9a70-4859-b339-b273cbbeb007 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:19.111641 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3854605b-9a70-4859-b339-b273cbbeb007 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:19.112458 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3854605b-9a70-4859-b339-b273cbbeb007 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:19.112905 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3854605b-9a70-4859-b339-b273cbbeb007 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:19.198895 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3854605b-9a70-4859-b339-b273cbbeb007 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 35226 microversion: 2.20 time: 0.100469 Jan 19 13:12:19.199567 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 527/1044] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:19 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 35226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:19.960217 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a1f3b1c5-19b8-440d-b9ef-1fe590a74ed4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:19.961252 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a1f3b1c5-19b8-440d-b9ef-1fe590a74ed4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:19.968126 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a1f3b1c5-19b8-440d-b9ef-1fe590a74ed4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:19.968585 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a1f3b1c5-19b8-440d-b9ef-1fe590a74ed4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:19.969376 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a1f3b1c5-19b8-440d-b9ef-1fe590a74ed4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:19.969801 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a1f3b1c5-19b8-440d-b9ef-1fe590a74ed4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:20.033728 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a1f3b1c5-19b8-440d-b9ef-1fe590a74ed4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28233 microversion: 2.1 time: 0.078027 Jan 19 13:12:20.034629 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 518/1045] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:19 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28233 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:20.212101 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e36765c5-3e5f-443d-9557-a803b853b594 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:20.213037 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e36765c5-3e5f-443d-9557-a803b853b594 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:20.219897 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e36765c5-3e5f-443d-9557-a803b853b594 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:20.220376 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e36765c5-3e5f-443d-9557-a803b853b594 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:20.221155 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e36765c5-3e5f-443d-9557-a803b853b594 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:20.221599 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e36765c5-3e5f-443d-9557-a803b853b594 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:20.305330 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e36765c5-3e5f-443d-9557-a803b853b594 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 36783 microversion: 2.20 time: 0.098111 Jan 19 13:12:20.305977 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 528/1046] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:20 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 36783 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:21.045651 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-adea8faa-f5bd-4104-bab7-bbe404f56ebd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:21.046660 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-adea8faa-f5bd-4104-bab7-bbe404f56ebd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:21.054283 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-adea8faa-f5bd-4104-bab7-bbe404f56ebd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:21.054743 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-adea8faa-f5bd-4104-bab7-bbe404f56ebd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:21.055525 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-adea8faa-f5bd-4104-bab7-bbe404f56ebd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:21.055965 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-adea8faa-f5bd-4104-bab7-bbe404f56ebd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:21.121809 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-adea8faa-f5bd-4104-bab7-bbe404f56ebd tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28233 microversion: 2.1 time: 0.080084 Jan 19 13:12:21.122360 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 519/1047] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:21 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28233 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:21.317609 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a38f5206-3939-4a9e-a8a7-5bb31d03ade8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:21.318646 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a38f5206-3939-4a9e-a8a7-5bb31d03ade8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:21.326335 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a38f5206-3939-4a9e-a8a7-5bb31d03ade8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:21.326788 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a38f5206-3939-4a9e-a8a7-5bb31d03ade8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:21.327574 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a38f5206-3939-4a9e-a8a7-5bb31d03ade8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:21.328032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a38f5206-3939-4a9e-a8a7-5bb31d03ade8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:21.398912 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a38f5206-3939-4a9e-a8a7-5bb31d03ade8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 38231 microversion: 2.20 time: 0.085169 Jan 19 13:12:21.399467 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 529/1048] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:21 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 38231 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:22.135405 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2fe96512-758d-4cc1-9249-dfb122805bb4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:22.136469 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2fe96512-758d-4cc1-9249-dfb122805bb4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:22.147526 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2fe96512-758d-4cc1-9249-dfb122805bb4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:22.148205 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2fe96512-758d-4cc1-9249-dfb122805bb4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:22.149058 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2fe96512-758d-4cc1-9249-dfb122805bb4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:22.149499 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2fe96512-758d-4cc1-9249-dfb122805bb4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:22.209391 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2fe96512-758d-4cc1-9249-dfb122805bb4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28233 microversion: 2.1 time: 0.078888 Jan 19 13:12:22.210437 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 520/1049] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:22 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28233 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:22.411390 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4650adf8-868e-4fe6-a60f-14ab4bf4628f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:22.412930 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4650adf8-868e-4fe6-a60f-14ab4bf4628f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:22.420365 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4650adf8-868e-4fe6-a60f-14ab4bf4628f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:22.420820 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4650adf8-868e-4fe6-a60f-14ab4bf4628f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:22.421597 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4650adf8-868e-4fe6-a60f-14ab4bf4628f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:22.422034 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4650adf8-868e-4fe6-a60f-14ab4bf4628f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:22.486938 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4650adf8-868e-4fe6-a60f-14ab4bf4628f tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 38231 microversion: 2.20 time: 0.079491 Jan 19 13:12:22.487743 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 530/1050] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:22 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 38231 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:23.221338 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-967b7d2b-8443-49c6-8881-c9c4c045ea32 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:23.222307 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-967b7d2b-8443-49c6-8881-c9c4c045ea32 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:23.229755 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-967b7d2b-8443-49c6-8881-c9c4c045ea32 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:23.230212 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-967b7d2b-8443-49c6-8881-c9c4c045ea32 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:23.231029 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-967b7d2b-8443-49c6-8881-c9c4c045ea32 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:23.231475 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-967b7d2b-8443-49c6-8881-c9c4c045ea32 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:23.299338 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-967b7d2b-8443-49c6-8881-c9c4c045ea32 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28233 microversion: 2.1 time: 0.082025 Jan 19 13:12:23.299974 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 521/1051] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:23 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28233 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:23.500046 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-107f7b05-c41e-4d5a-8e12-707646f275fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:23.500961 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-107f7b05-c41e-4d5a-8e12-707646f275fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:23.507758 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-107f7b05-c41e-4d5a-8e12-707646f275fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:23.508479 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-107f7b05-c41e-4d5a-8e12-707646f275fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:23.509242 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-107f7b05-c41e-4d5a-8e12-707646f275fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:23.509677 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-107f7b05-c41e-4d5a-8e12-707646f275fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:23.569659 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-107f7b05-c41e-4d5a-8e12-707646f275fa tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 38231 microversion: 2.20 time: 0.073615 Jan 19 13:12:23.570569 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 531/1052] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:23 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 38231 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:24.311846 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-77ff25ee-9dcc-49cb-ae4a-10d38bfa0940 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:24.312882 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-77ff25ee-9dcc-49cb-ae4a-10d38bfa0940 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:24.320542 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-77ff25ee-9dcc-49cb-ae4a-10d38bfa0940 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:24.320990 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-77ff25ee-9dcc-49cb-ae4a-10d38bfa0940 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:24.321756 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-77ff25ee-9dcc-49cb-ae4a-10d38bfa0940 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:24.322190 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-77ff25ee-9dcc-49cb-ae4a-10d38bfa0940 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:24.384047 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-77ff25ee-9dcc-49cb-ae4a-10d38bfa0940 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28233 microversion: 2.1 time: 0.076109 Jan 19 13:12:24.384666 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 522/1053] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:24 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28233 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:24.582065 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8c1270dc-f8df-42c7-94b1-19eb932d7a21 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:24.582991 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8c1270dc-f8df-42c7-94b1-19eb932d7a21 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:24.589960 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c1270dc-f8df-42c7-94b1-19eb932d7a21 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:24.590414 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c1270dc-f8df-42c7-94b1-19eb932d7a21 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:24.591198 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c1270dc-f8df-42c7-94b1-19eb932d7a21 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:24.591640 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8c1270dc-f8df-42c7-94b1-19eb932d7a21 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:24.656435 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8c1270dc-f8df-42c7-94b1-19eb932d7a21 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 38231 microversion: 2.20 time: 0.078331 Jan 19 13:12:24.657117 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 532/1054] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:24 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 38231 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:25.395099 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-bd0e76d1-a877-422c-9335-6ac4c734dd89 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:25.396130 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-bd0e76d1-a877-422c-9335-6ac4c734dd89 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:25.404118 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bd0e76d1-a877-422c-9335-6ac4c734dd89 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:25.404575 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bd0e76d1-a877-422c-9335-6ac4c734dd89 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:25.405355 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bd0e76d1-a877-422c-9335-6ac4c734dd89 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:25.405797 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bd0e76d1-a877-422c-9335-6ac4c734dd89 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:25.469768 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-bd0e76d1-a877-422c-9335-6ac4c734dd89 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28233 microversion: 2.1 time: 0.078453 Jan 19 13:12:25.470580 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 523/1055] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:25 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28233 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:25.669015 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ef483d46-cbc1-4f8f-a005-67821f8a4803 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:25.670027 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ef483d46-cbc1-4f8f-a005-67821f8a4803 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:25.676917 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ef483d46-cbc1-4f8f-a005-67821f8a4803 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:25.677379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ef483d46-cbc1-4f8f-a005-67821f8a4803 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:25.679142 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ef483d46-cbc1-4f8f-a005-67821f8a4803 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:25.679354 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ef483d46-cbc1-4f8f-a005-67821f8a4803 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:25.761865 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ef483d46-cbc1-4f8f-a005-67821f8a4803 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 200 len: 38374 microversion: 2.20 time: 0.096709 Jan 19 13:12:25.762454 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 533/1056] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:25 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 38374 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:12:25.772684 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-affc0c12-99df-4f2c-ac6f-bb67b57f5463 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:25.773268 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-affc0c12-99df-4f2c-ac6f-bb67b57f5463 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:25.780145 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-affc0c12-99df-4f2c-ac6f-bb67b57f5463 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:25.780598 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-affc0c12-99df-4f2c-ac6f-bb67b57f5463 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:25.781379 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-affc0c12-99df-4f2c-ac6f-bb67b57f5463 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:25.781823 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-affc0c12-99df-4f2c-ac6f-bb67b57f5463 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:25.805681 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-affc0c12-99df-4f2c-ac6f-bb67b57f5463 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/ips" status: 200 len: 152 microversion: 2.20 time: 0.037078 Jan 19 13:12:25.806245 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 524/1057] 10.222.0.48 () {60 vars in 1288 bytes} [Wed Jan 19 13:12:25 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:26.481806 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5535d260-9f13-438d-bf9a-7c27ea828b26 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:26.482815 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5535d260-9f13-438d-bf9a-7c27ea828b26 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:26.490032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5535d260-9f13-438d-bf9a-7c27ea828b26 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:26.490978 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5535d260-9f13-438d-bf9a-7c27ea828b26 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:26.491786 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5535d260-9f13-438d-bf9a-7c27ea828b26 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:26.492251 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5535d260-9f13-438d-bf9a-7c27ea828b26 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:26.576548 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5535d260-9f13-438d-bf9a-7c27ea828b26 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28524 microversion: 2.1 time: 0.098495 Jan 19 13:12:26.577706 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 534/1058] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:26 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28524 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:27.590717 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-fcc0b15b-7c7b-4e99-8c5d-f0de918c3ca9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:27.591632 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-fcc0b15b-7c7b-4e99-8c5d-f0de918c3ca9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:27.597900 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fcc0b15b-7c7b-4e99-8c5d-f0de918c3ca9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:27.598352 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fcc0b15b-7c7b-4e99-8c5d-f0de918c3ca9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:27.599152 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fcc0b15b-7c7b-4e99-8c5d-f0de918c3ca9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:27.599592 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fcc0b15b-7c7b-4e99-8c5d-f0de918c3ca9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:27.658948 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-fcc0b15b-7c7b-4e99-8c5d-f0de918c3ca9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28524 microversion: 2.1 time: 0.071814 Jan 19 13:12:27.659607 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 525/1059] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:27 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28524 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:27.942331 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1f66bb5d-e0e0-453b-a5b6-5a921e47ff17 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:27.942954 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1f66bb5d-e0e0-453b-a5b6-5a921e47ff17 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:27.950062 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1f66bb5d-e0e0-453b-a5b6-5a921e47ff17 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:27.950523 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1f66bb5d-e0e0-453b-a5b6-5a921e47ff17 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:27.951304 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1f66bb5d-e0e0-453b-a5b6-5a921e47ff17 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:27.951747 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1f66bb5d-e0e0-453b-a5b6-5a921e47ff17 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:27.974509 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.objects.instance [None req-1f66bb5d-e0e0-453b-a5b6-5a921e47ff17 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lazy-loading 'flavor' on Instance uuid 16d2bd3e-47a3-4158-892e-627b3f1c1095 {{(pid=116361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:12:28.241889 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1f66bb5d-e0e0-453b-a5b6-5a921e47ff17 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 202 len: 0 microversion: 2.20 time: 0.303483 Jan 19 13:12:28.245622 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 535/1060] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:12:27 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:12:28.251173 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3c701032-a153-4baa-85ac-9fb80e08c2c7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:28.251870 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3c701032-a153-4baa-85ac-9fb80e08c2c7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:28.261538 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3c701032-a153-4baa-85ac-9fb80e08c2c7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:28.263136 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3c701032-a153-4baa-85ac-9fb80e08c2c7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:28.263947 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3c701032-a153-4baa-85ac-9fb80e08c2c7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:28.264776 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3c701032-a153-4baa-85ac-9fb80e08c2c7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:28.404344 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3c701032-a153-4baa-85ac-9fb80e08c2c7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:28.412158 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3c701032-a153-4baa-85ac-9fb80e08c2c7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:28.414091 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3c701032-a153-4baa-85ac-9fb80e08c2c7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:28.415268 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3c701032-a153-4baa-85ac-9fb80e08c2c7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.168146 Jan 19 13:12:28.415832 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 526/1061] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:28 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:28.671194 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-39a1c376-e63b-4489-869d-4c6c37cc7bf7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:28.672234 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-39a1c376-e63b-4489-869d-4c6c37cc7bf7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:28.679199 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-39a1c376-e63b-4489-869d-4c6c37cc7bf7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:28.679655 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-39a1c376-e63b-4489-869d-4c6c37cc7bf7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:28.680470 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-39a1c376-e63b-4489-869d-4c6c37cc7bf7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:28.680916 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-39a1c376-e63b-4489-869d-4c6c37cc7bf7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:28.760528 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-39a1c376-e63b-4489-869d-4c6c37cc7bf7 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.093688 Jan 19 13:12:28.761173 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 536/1062] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:28 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:29.433792 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a9d66cbf-f1fa-4e40-915e-b2688138bff6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:29.434381 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a9d66cbf-f1fa-4e40-915e-b2688138bff6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:29.440754 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9d66cbf-f1fa-4e40-915e-b2688138bff6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:29.441215 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9d66cbf-f1fa-4e40-915e-b2688138bff6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:29.442024 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9d66cbf-f1fa-4e40-915e-b2688138bff6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:29.442466 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9d66cbf-f1fa-4e40-915e-b2688138bff6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:29.570448 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a9d66cbf-f1fa-4e40-915e-b2688138bff6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:29.578180 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a9d66cbf-f1fa-4e40-915e-b2688138bff6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:29.579694 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a9d66cbf-f1fa-4e40-915e-b2688138bff6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:29.580883 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a9d66cbf-f1fa-4e40-915e-b2688138bff6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.150964 Jan 19 13:12:29.581442 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 527/1063] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:29 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:29.772899 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-19ed73b3-e846-4de3-957c-5d20627cb8b4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:29.773821 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-19ed73b3-e846-4de3-957c-5d20627cb8b4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:29.780681 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-19ed73b3-e846-4de3-957c-5d20627cb8b4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:29.781136 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-19ed73b3-e846-4de3-957c-5d20627cb8b4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:29.781915 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-19ed73b3-e846-4de3-957c-5d20627cb8b4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:29.782355 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-19ed73b3-e846-4de3-957c-5d20627cb8b4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:29.847537 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-19ed73b3-e846-4de3-957c-5d20627cb8b4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.078954 Jan 19 13:12:29.848185 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 537/1064] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:29 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:30.599198 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a9ae02bf-2a82-4f15-8071-875ef3b76aec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:30.600672 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a9ae02bf-2a82-4f15-8071-875ef3b76aec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:30.607127 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9ae02bf-2a82-4f15-8071-875ef3b76aec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:30.607580 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9ae02bf-2a82-4f15-8071-875ef3b76aec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:30.608397 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9ae02bf-2a82-4f15-8071-875ef3b76aec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:30.608835 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9ae02bf-2a82-4f15-8071-875ef3b76aec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:30.737552 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a9ae02bf-2a82-4f15-8071-875ef3b76aec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:30.746034 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a9ae02bf-2a82-4f15-8071-875ef3b76aec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:30.747533 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a9ae02bf-2a82-4f15-8071-875ef3b76aec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:30.748726 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a9ae02bf-2a82-4f15-8071-875ef3b76aec tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.153249 Jan 19 13:12:30.749281 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 528/1065] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:30 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:30.860482 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9ea17d61-da0d-48d6-b684-40633ef5eb22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:30.861431 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9ea17d61-da0d-48d6-b684-40633ef5eb22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:30.868725 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9ea17d61-da0d-48d6-b684-40633ef5eb22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:30.869184 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9ea17d61-da0d-48d6-b684-40633ef5eb22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:30.869976 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9ea17d61-da0d-48d6-b684-40633ef5eb22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:30.870419 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9ea17d61-da0d-48d6-b684-40633ef5eb22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:30.936476 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9ea17d61-da0d-48d6-b684-40633ef5eb22 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.079955 Jan 19 13:12:30.937105 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 538/1066] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:30 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:31.767199 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d48786e5-a17a-4f4f-beee-23fb55f7ad7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:31.767802 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d48786e5-a17a-4f4f-beee-23fb55f7ad7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:31.774279 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d48786e5-a17a-4f4f-beee-23fb55f7ad7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:31.774732 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d48786e5-a17a-4f4f-beee-23fb55f7ad7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:31.775546 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d48786e5-a17a-4f4f-beee-23fb55f7ad7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:31.776004 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d48786e5-a17a-4f4f-beee-23fb55f7ad7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:31.903892 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d48786e5-a17a-4f4f-beee-23fb55f7ad7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:31.914069 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d48786e5-a17a-4f4f-beee-23fb55f7ad7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:31.915583 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d48786e5-a17a-4f4f-beee-23fb55f7ad7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:31.916785 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d48786e5-a17a-4f4f-beee-23fb55f7ad7c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.153333 Jan 19 13:12:31.917373 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 529/1067] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:31 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:31.949107 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d72ad403-9ec3-42e8-a9fd-167ac9d42e08 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:31.950111 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d72ad403-9ec3-42e8-a9fd-167ac9d42e08 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:31.957122 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d72ad403-9ec3-42e8-a9fd-167ac9d42e08 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:31.957579 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d72ad403-9ec3-42e8-a9fd-167ac9d42e08 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:31.958361 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d72ad403-9ec3-42e8-a9fd-167ac9d42e08 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:31.958799 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d72ad403-9ec3-42e8-a9fd-167ac9d42e08 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:32.018722 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d72ad403-9ec3-42e8-a9fd-167ac9d42e08 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.073501 Jan 19 13:12:32.019485 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 539/1068] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:31 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:32.933829 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-75d71181-6a2a-40ac-8b74-e5c0d1dfd0e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:32.934436 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-75d71181-6a2a-40ac-8b74-e5c0d1dfd0e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:32.940787 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-75d71181-6a2a-40ac-8b74-e5c0d1dfd0e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:32.941245 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-75d71181-6a2a-40ac-8b74-e5c0d1dfd0e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:32.942025 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-75d71181-6a2a-40ac-8b74-e5c0d1dfd0e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:32.942545 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-75d71181-6a2a-40ac-8b74-e5c0d1dfd0e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:33.030790 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d4e904b3-f00c-424c-bc54-51731326c2d8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:33.031791 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d4e904b3-f00c-424c-bc54-51731326c2d8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:33.038833 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d4e904b3-f00c-424c-bc54-51731326c2d8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:33.039289 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d4e904b3-f00c-424c-bc54-51731326c2d8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:33.040103 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d4e904b3-f00c-424c-bc54-51731326c2d8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:33.040541 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d4e904b3-f00c-424c-bc54-51731326c2d8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:33.074904 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-75d71181-6a2a-40ac-8b74-e5c0d1dfd0e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:33.082574 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-75d71181-6a2a-40ac-8b74-e5c0d1dfd0e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:33.084727 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-75d71181-6a2a-40ac-8b74-e5c0d1dfd0e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:33.085984 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-75d71181-6a2a-40ac-8b74-e5c0d1dfd0e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.155926 Jan 19 13:12:33.086547 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 530/1069] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:32 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:33.101246 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d4e904b3-f00c-424c-bc54-51731326c2d8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.074351 Jan 19 13:12:33.101892 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 540/1070] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:33 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:34.103925 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c81d2965-30ca-4643-a835-7de510fb1c63 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:34.104554 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c81d2965-30ca-4643-a835-7de510fb1c63 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:34.110887 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c81d2965-30ca-4643-a835-7de510fb1c63 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:34.111337 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c81d2965-30ca-4643-a835-7de510fb1c63 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:34.112145 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c81d2965-30ca-4643-a835-7de510fb1c63 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:34.112586 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c81d2965-30ca-4643-a835-7de510fb1c63 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:34.113013 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-917f37f1-9db2-4418-a924-39b530df7316 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:34.114010 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-917f37f1-9db2-4418-a924-39b530df7316 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:34.121766 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-917f37f1-9db2-4418-a924-39b530df7316 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:34.122466 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-917f37f1-9db2-4418-a924-39b530df7316 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:34.123816 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-917f37f1-9db2-4418-a924-39b530df7316 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:34.124640 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-917f37f1-9db2-4418-a924-39b530df7316 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:34.191147 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-917f37f1-9db2-4418-a924-39b530df7316 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.081815 Jan 19 13:12:34.195465 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 541/1071] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:34 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:12:34.249048 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c81d2965-30ca-4643-a835-7de510fb1c63 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:34.257020 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c81d2965-30ca-4643-a835-7de510fb1c63 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:34.258779 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c81d2965-30ca-4643-a835-7de510fb1c63 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:34.259926 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c81d2965-30ca-4643-a835-7de510fb1c63 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.159755 Jan 19 13:12:34.260520 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 531/1072] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:34 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:35.203764 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9c121dad-3425-4417-87b5-a0cd58c85073 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:35.204712 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9c121dad-3425-4417-87b5-a0cd58c85073 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:35.211521 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9c121dad-3425-4417-87b5-a0cd58c85073 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:35.211969 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9c121dad-3425-4417-87b5-a0cd58c85073 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:35.212761 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9c121dad-3425-4417-87b5-a0cd58c85073 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:35.213190 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9c121dad-3425-4417-87b5-a0cd58c85073 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:35.274074 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9c121dad-3425-4417-87b5-a0cd58c85073 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.074352 Jan 19 13:12:35.274719 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 542/1073] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:35 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:35.278196 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-24a3e3ad-7da4-473f-9b19-293b569bba1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:35.278835 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-24a3e3ad-7da4-473f-9b19-293b569bba1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:35.285962 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-24a3e3ad-7da4-473f-9b19-293b569bba1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:35.285962 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-24a3e3ad-7da4-473f-9b19-293b569bba1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:35.286729 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-24a3e3ad-7da4-473f-9b19-293b569bba1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:35.287723 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-24a3e3ad-7da4-473f-9b19-293b569bba1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:35.415406 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-24a3e3ad-7da4-473f-9b19-293b569bba1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:35.423089 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-24a3e3ad-7da4-473f-9b19-293b569bba1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:35.424647 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-24a3e3ad-7da4-473f-9b19-293b569bba1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:35.425805 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-24a3e3ad-7da4-473f-9b19-293b569bba1d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.151349 Jan 19 13:12:35.426363 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 532/1074] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:35 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:12:36.286265 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9039d9af-7d86-4a68-97e4-ccc94cd58ead tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:36.287721 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9039d9af-7d86-4a68-97e4-ccc94cd58ead tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:36.294609 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9039d9af-7d86-4a68-97e4-ccc94cd58ead tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:36.295066 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9039d9af-7d86-4a68-97e4-ccc94cd58ead tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:36.295855 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9039d9af-7d86-4a68-97e4-ccc94cd58ead tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:36.296319 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9039d9af-7d86-4a68-97e4-ccc94cd58ead tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:36.356398 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9039d9af-7d86-4a68-97e4-ccc94cd58ead tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.074089 Jan 19 13:12:36.357021 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 543/1075] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:36 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:36.444544 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4c3ada0a-3c22-49a4-92f9-362e68edbdf9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:36.445147 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4c3ada0a-3c22-49a4-92f9-362e68edbdf9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:36.451422 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c3ada0a-3c22-49a4-92f9-362e68edbdf9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:36.451872 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c3ada0a-3c22-49a4-92f9-362e68edbdf9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:36.452703 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c3ada0a-3c22-49a4-92f9-362e68edbdf9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:36.453141 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c3ada0a-3c22-49a4-92f9-362e68edbdf9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:36.583195 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4c3ada0a-3c22-49a4-92f9-362e68edbdf9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:36.591639 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4c3ada0a-3c22-49a4-92f9-362e68edbdf9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:36.593619 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4c3ada0a-3c22-49a4-92f9-362e68edbdf9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:36.594758 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4c3ada0a-3c22-49a4-92f9-362e68edbdf9 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.154736 Jan 19 13:12:36.595311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 533/1076] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:36 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:37.368909 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-502d5f28-7b49-4031-8b2e-cd1d6765df43 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:37.369927 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-502d5f28-7b49-4031-8b2e-cd1d6765df43 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:37.376857 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-502d5f28-7b49-4031-8b2e-cd1d6765df43 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:37.377311 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-502d5f28-7b49-4031-8b2e-cd1d6765df43 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:37.378088 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-502d5f28-7b49-4031-8b2e-cd1d6765df43 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:37.378529 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-502d5f28-7b49-4031-8b2e-cd1d6765df43 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:37.437982 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-502d5f28-7b49-4031-8b2e-cd1d6765df43 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.073793 Jan 19 13:12:37.438602 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 544/1077] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:37 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:37.614365 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7253beb6-41f7-45b9-b86d-276f4d5239e6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:37.615054 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7253beb6-41f7-45b9-b86d-276f4d5239e6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:37.621668 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7253beb6-41f7-45b9-b86d-276f4d5239e6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:37.622060 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7253beb6-41f7-45b9-b86d-276f4d5239e6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:37.622878 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7253beb6-41f7-45b9-b86d-276f4d5239e6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:37.623321 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7253beb6-41f7-45b9-b86d-276f4d5239e6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:37.751543 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7253beb6-41f7-45b9-b86d-276f4d5239e6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:37.760069 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7253beb6-41f7-45b9-b86d-276f4d5239e6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:37.761580 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7253beb6-41f7-45b9-b86d-276f4d5239e6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:37.762730 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7253beb6-41f7-45b9-b86d-276f4d5239e6 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.152093 Jan 19 13:12:37.763276 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 534/1078] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:37 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:38.449963 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-33498607-6393-453f-b677-bcc99fd8012e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:38.450972 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-33498607-6393-453f-b677-bcc99fd8012e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:38.457973 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33498607-6393-453f-b677-bcc99fd8012e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:38.458431 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33498607-6393-453f-b677-bcc99fd8012e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:38.459210 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33498607-6393-453f-b677-bcc99fd8012e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:38.459657 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33498607-6393-453f-b677-bcc99fd8012e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:38.536387 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-33498607-6393-453f-b677-bcc99fd8012e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.090193 Jan 19 13:12:38.536952 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 545/1079] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:38 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:38.781559 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d4d3e47c-e0f8-48d8-98f6-1c8bfc35b2ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:38.782159 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d4d3e47c-e0f8-48d8-98f6-1c8bfc35b2ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:38.788754 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d4d3e47c-e0f8-48d8-98f6-1c8bfc35b2ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:38.789149 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d4d3e47c-e0f8-48d8-98f6-1c8bfc35b2ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:38.789929 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d4d3e47c-e0f8-48d8-98f6-1c8bfc35b2ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:38.790365 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d4d3e47c-e0f8-48d8-98f6-1c8bfc35b2ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:38.918898 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d4d3e47c-e0f8-48d8-98f6-1c8bfc35b2ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:38.926674 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d4d3e47c-e0f8-48d8-98f6-1c8bfc35b2ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:38.928209 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d4d3e47c-e0f8-48d8-98f6-1c8bfc35b2ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:38.929511 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d4d3e47c-e0f8-48d8-98f6-1c8bfc35b2ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.151657 Jan 19 13:12:38.930067 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 535/1080] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:38 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:39.560445 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7c829c03-977d-4335-9bd0-ae8dc5b65535 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:39.561470 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7c829c03-977d-4335-9bd0-ae8dc5b65535 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:39.568852 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7c829c03-977d-4335-9bd0-ae8dc5b65535 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:39.569435 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7c829c03-977d-4335-9bd0-ae8dc5b65535 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:39.570256 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7c829c03-977d-4335-9bd0-ae8dc5b65535 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:39.570737 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7c829c03-977d-4335-9bd0-ae8dc5b65535 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:39.633557 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7c829c03-977d-4335-9bd0-ae8dc5b65535 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.082000 Jan 19 13:12:39.634267 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 546/1081] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:39 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:39.946600 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5b78c59b-f399-4a5f-92c0-161d40ad2bc3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:39.947205 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5b78c59b-f399-4a5f-92c0-161d40ad2bc3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:39.953601 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5b78c59b-f399-4a5f-92c0-161d40ad2bc3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:39.954065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5b78c59b-f399-4a5f-92c0-161d40ad2bc3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:39.954843 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5b78c59b-f399-4a5f-92c0-161d40ad2bc3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:39.955290 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5b78c59b-f399-4a5f-92c0-161d40ad2bc3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:40.088904 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5b78c59b-f399-4a5f-92c0-161d40ad2bc3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:40.096688 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5b78c59b-f399-4a5f-92c0-161d40ad2bc3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:40.098181 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5b78c59b-f399-4a5f-92c0-161d40ad2bc3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:40.099331 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5b78c59b-f399-4a5f-92c0-161d40ad2bc3 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.156540 Jan 19 13:12:40.099892 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 536/1082] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:39 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:40.645375 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ac9f12a9-7ef6-4a13-97ba-69acc548c1c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:40.646370 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ac9f12a9-7ef6-4a13-97ba-69acc548c1c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:40.653692 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ac9f12a9-7ef6-4a13-97ba-69acc548c1c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:40.654136 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ac9f12a9-7ef6-4a13-97ba-69acc548c1c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:40.654937 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ac9f12a9-7ef6-4a13-97ba-69acc548c1c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:40.655370 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ac9f12a9-7ef6-4a13-97ba-69acc548c1c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:40.716988 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ac9f12a9-7ef6-4a13-97ba-69acc548c1c1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.075549 Jan 19 13:12:40.717638 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 547/1083] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:40 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:41.118337 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2b4491f1-3d25-4cc0-ba8e-7e711ac2d9ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:41.118942 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2b4491f1-3d25-4cc0-ba8e-7e711ac2d9ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:41.125263 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2b4491f1-3d25-4cc0-ba8e-7e711ac2d9ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:41.125717 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2b4491f1-3d25-4cc0-ba8e-7e711ac2d9ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:41.126498 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2b4491f1-3d25-4cc0-ba8e-7e711ac2d9ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:41.126939 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2b4491f1-3d25-4cc0-ba8e-7e711ac2d9ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:41.252359 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2b4491f1-3d25-4cc0-ba8e-7e711ac2d9ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:41.261008 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2b4491f1-3d25-4cc0-ba8e-7e711ac2d9ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:41.262514 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2b4491f1-3d25-4cc0-ba8e-7e711ac2d9ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:41.263678 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2b4491f1-3d25-4cc0-ba8e-7e711ac2d9ca tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.149502 Jan 19 13:12:41.264275 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 537/1084] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:41 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:41.729887 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-11a06286-4b9f-48c5-b5a6-ecd69d2b2b76 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:41.731014 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-11a06286-4b9f-48c5-b5a6-ecd69d2b2b76 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:41.738392 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-11a06286-4b9f-48c5-b5a6-ecd69d2b2b76 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:41.738897 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-11a06286-4b9f-48c5-b5a6-ecd69d2b2b76 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:41.739700 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-11a06286-4b9f-48c5-b5a6-ecd69d2b2b76 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:41.740174 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-11a06286-4b9f-48c5-b5a6-ecd69d2b2b76 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:41.800121 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-11a06286-4b9f-48c5-b5a6-ecd69d2b2b76 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.074904 Jan 19 13:12:41.800785 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 548/1085] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:41 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:42.282505 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2ffcf3c9-48ce-4248-a667-a708e0b84909 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:42.283103 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2ffcf3c9-48ce-4248-a667-a708e0b84909 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:42.290660 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ffcf3c9-48ce-4248-a667-a708e0b84909 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:42.291113 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ffcf3c9-48ce-4248-a667-a708e0b84909 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:42.291885 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ffcf3c9-48ce-4248-a667-a708e0b84909 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:42.292346 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ffcf3c9-48ce-4248-a667-a708e0b84909 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:42.421231 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2ffcf3c9-48ce-4248-a667-a708e0b84909 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:42.429204 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2ffcf3c9-48ce-4248-a667-a708e0b84909 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:42.430717 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2ffcf3c9-48ce-4248-a667-a708e0b84909 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:42.431877 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2ffcf3c9-48ce-4248-a667-a708e0b84909 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.153132 Jan 19 13:12:42.432469 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 538/1086] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:42 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:42.812915 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6080e691-d63e-4876-a33c-53f3546f740d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:42.813988 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6080e691-d63e-4876-a33c-53f3546f740d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:42.821595 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6080e691-d63e-4876-a33c-53f3546f740d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:42.822059 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6080e691-d63e-4876-a33c-53f3546f740d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:42.822880 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6080e691-d63e-4876-a33c-53f3546f740d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:42.823325 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6080e691-d63e-4876-a33c-53f3546f740d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:42.883295 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6080e691-d63e-4876-a33c-53f3546f740d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.072993 Jan 19 13:12:42.883951 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 549/1087] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:42 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:43.449814 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-321d7727-36d3-41a9-b94f-c7be1fa80a6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:43.450428 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-321d7727-36d3-41a9-b94f-c7be1fa80a6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:43.456822 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-321d7727-36d3-41a9-b94f-c7be1fa80a6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:43.457281 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-321d7727-36d3-41a9-b94f-c7be1fa80a6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:43.458064 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-321d7727-36d3-41a9-b94f-c7be1fa80a6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:43.458509 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-321d7727-36d3-41a9-b94f-c7be1fa80a6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:43.587550 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-321d7727-36d3-41a9-b94f-c7be1fa80a6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:43.595350 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-321d7727-36d3-41a9-b94f-c7be1fa80a6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:43.596889 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-321d7727-36d3-41a9-b94f-c7be1fa80a6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:43.598046 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-321d7727-36d3-41a9-b94f-c7be1fa80a6d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.152001 Jan 19 13:12:43.598612 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 539/1088] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:43 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:43.894695 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-528966e7-4ba9-4664-913d-0cc5a183d555 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:43.895719 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-528966e7-4ba9-4664-913d-0cc5a183d555 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:43.903092 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-528966e7-4ba9-4664-913d-0cc5a183d555 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:43.903536 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-528966e7-4ba9-4664-913d-0cc5a183d555 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:43.904338 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-528966e7-4ba9-4664-913d-0cc5a183d555 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:43.904773 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-528966e7-4ba9-4664-913d-0cc5a183d555 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:44.337029 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-528966e7-4ba9-4664-913d-0cc5a183d555 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.446131 Jan 19 13:12:44.337951 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 550/1089] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:43 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:44.616606 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-91f24604-a63b-46b3-a4b1-6c59de83af11 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:44.617316 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-91f24604-a63b-46b3-a4b1-6c59de83af11 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:44.623605 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-91f24604-a63b-46b3-a4b1-6c59de83af11 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:44.624078 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-91f24604-a63b-46b3-a4b1-6c59de83af11 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:44.624851 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-91f24604-a63b-46b3-a4b1-6c59de83af11 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:44.625280 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-91f24604-a63b-46b3-a4b1-6c59de83af11 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:44.755486 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-91f24604-a63b-46b3-a4b1-6c59de83af11 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:44.763544 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-91f24604-a63b-46b3-a4b1-6c59de83af11 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:44.765090 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-91f24604-a63b-46b3-a4b1-6c59de83af11 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:44.766237 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-91f24604-a63b-46b3-a4b1-6c59de83af11 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1744 microversion: 2.20 time: 0.153970 Jan 19 13:12:44.766804 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 540/1090] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:44 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:45.348512 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f445f655-6b93-4742-81de-b4a41884b7e3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:45.349588 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f445f655-6b93-4742-81de-b4a41884b7e3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:45.357097 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f445f655-6b93-4742-81de-b4a41884b7e3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:45.357601 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f445f655-6b93-4742-81de-b4a41884b7e3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:45.358517 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f445f655-6b93-4742-81de-b4a41884b7e3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:45.358966 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f445f655-6b93-4742-81de-b4a41884b7e3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:45.418916 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f445f655-6b93-4742-81de-b4a41884b7e3 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.074390 Jan 19 13:12:45.419602 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 551/1091] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:45 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:45.784536 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d2378c0e-4334-45f8-adeb-6fe31595d41c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:45.785077 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d2378c0e-4334-45f8-adeb-6fe31595d41c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:45.791392 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d2378c0e-4334-45f8-adeb-6fe31595d41c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:45.791847 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d2378c0e-4334-45f8-adeb-6fe31595d41c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:45.792676 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d2378c0e-4334-45f8-adeb-6fe31595d41c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:45.793118 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d2378c0e-4334-45f8-adeb-6fe31595d41c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:45.921545 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d2378c0e-4334-45f8-adeb-6fe31595d41c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:45.929994 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d2378c0e-4334-45f8-adeb-6fe31595d41c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:45.931480 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d2378c0e-4334-45f8-adeb-6fe31595d41c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:45.932643 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d2378c0e-4334-45f8-adeb-6fe31595d41c tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1744 microversion: 2.20 time: 0.152002 Jan 19 13:12:45.933201 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 541/1092] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:45 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:46.432778 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-35489d65-77cf-44a5-a226-5058fd224c93 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:46.433784 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-35489d65-77cf-44a5-a226-5058fd224c93 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:46.440299 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-35489d65-77cf-44a5-a226-5058fd224c93 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:46.440792 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-35489d65-77cf-44a5-a226-5058fd224c93 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:46.441639 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-35489d65-77cf-44a5-a226-5058fd224c93 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:46.442131 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-35489d65-77cf-44a5-a226-5058fd224c93 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:46.502253 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-35489d65-77cf-44a5-a226-5058fd224c93 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.074618 Jan 19 13:12:46.503119 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 552/1093] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:46 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:12:46.951371 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c010789d-ed8a-4ad8-a35f-d921a4032edb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:46.952005 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c010789d-ed8a-4ad8-a35f-d921a4032edb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:46.958304 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c010789d-ed8a-4ad8-a35f-d921a4032edb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:46.958756 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c010789d-ed8a-4ad8-a35f-d921a4032edb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:46.960285 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c010789d-ed8a-4ad8-a35f-d921a4032edb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:46.960739 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c010789d-ed8a-4ad8-a35f-d921a4032edb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:47.086805 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c010789d-ed8a-4ad8-a35f-d921a4032edb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:47.094461 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c010789d-ed8a-4ad8-a35f-d921a4032edb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:47.095959 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c010789d-ed8a-4ad8-a35f-d921a4032edb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:47.097117 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c010789d-ed8a-4ad8-a35f-d921a4032edb tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1744 microversion: 2.20 time: 0.149616 Jan 19 13:12:47.097668 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 542/1094] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:46 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:47.514353 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1307e765-1899-468d-af39-add0c843f0f6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:47.515957 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1307e765-1899-468d-af39-add0c843f0f6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:47.522914 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1307e765-1899-468d-af39-add0c843f0f6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:47.523371 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1307e765-1899-468d-af39-add0c843f0f6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:47.524177 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1307e765-1899-468d-af39-add0c843f0f6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:47.524612 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1307e765-1899-468d-af39-add0c843f0f6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:47.592978 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1307e765-1899-468d-af39-add0c843f0f6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.082490 Jan 19 13:12:47.593871 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 553/1095] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:47 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:48.115482 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-809f032c-919d-462e-a075-0092e6ad8c66 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:48.116140 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-809f032c-919d-462e-a075-0092e6ad8c66 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:48.122399 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-809f032c-919d-462e-a075-0092e6ad8c66 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:48.122844 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-809f032c-919d-462e-a075-0092e6ad8c66 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:48.123617 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-809f032c-919d-462e-a075-0092e6ad8c66 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:48.124080 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-809f032c-919d-462e-a075-0092e6ad8c66 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:48.263379 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-809f032c-919d-462e-a075-0092e6ad8c66 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:48.271247 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-809f032c-919d-462e-a075-0092e6ad8c66 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:48.273810 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-809f032c-919d-462e-a075-0092e6ad8c66 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:48.275397 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-809f032c-919d-462e-a075-0092e6ad8c66 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1744 microversion: 2.20 time: 0.163713 Jan 19 13:12:48.275952 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 543/1096] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:48 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:48.604963 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-20dd7bb6-3459-46e3-af21-1eadcf55bf41 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:48.605953 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-20dd7bb6-3459-46e3-af21-1eadcf55bf41 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:48.612745 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-20dd7bb6-3459-46e3-af21-1eadcf55bf41 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:48.613191 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-20dd7bb6-3459-46e3-af21-1eadcf55bf41 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:48.613961 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-20dd7bb6-3459-46e3-af21-1eadcf55bf41 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:48.614413 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-20dd7bb6-3459-46e3-af21-1eadcf55bf41 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:48.685199 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-20dd7bb6-3459-46e3-af21-1eadcf55bf41 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.084131 Jan 19 13:12:48.685853 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 554/1097] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:48 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:49.293000 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6e2ec4ab-e8fd-4b07-af38-8ac6013668fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:49.293602 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6e2ec4ab-e8fd-4b07-af38-8ac6013668fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:49.299913 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6e2ec4ab-e8fd-4b07-af38-8ac6013668fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:49.300413 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6e2ec4ab-e8fd-4b07-af38-8ac6013668fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:49.301499 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6e2ec4ab-e8fd-4b07-af38-8ac6013668fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:49.301940 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6e2ec4ab-e8fd-4b07-af38-8ac6013668fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:49.346893 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-af8f87ef-da54-489a-9938-c118f0e3b48d req-759f3645-eae2-486b-ae1a-d03f563a9b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d2bd3e-47a3-4158-892e-627b3f1c1095", "name": "network-vif-plugged", "status": "completed", "tag": "e6862281-58ef-4013-962c-3a0024140b3a"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:49.348461 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:12:49.348461 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:12:49.357542 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-af8f87ef-da54-489a-9938-c118f0e3b48d req-759f3645-eae2-486b-ae1a-d03f563a9b4a service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:49.357987 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-af8f87ef-da54-489a-9938-c118f0e3b48d req-759f3645-eae2-486b-ae1a-d03f563a9b4a service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:49.376025 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-af8f87ef-da54-489a-9938-c118f0e3b48d req-759f3645-eae2-486b-ae1a-d03f563a9b4a service nova] Creating event network-vif-plugged:e6862281-58ef-4013-962c-3a0024140b3a for instance 16d2bd3e-47a3-4158-892e-627b3f1c1095 on hv-cinder-82301 Jan 19 13:12:49.383623 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-af8f87ef-da54-489a-9938-c118f0e3b48d req-759f3645-eae2-486b-ae1a-d03f563a9b4a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040681 Jan 19 13:12:49.384566 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 555/1098] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:12:49.463683 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6e2ec4ab-e8fd-4b07-af38-8ac6013668fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:49.471510 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6e2ec4ab-e8fd-4b07-af38-8ac6013668fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:49.473044 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6e2ec4ab-e8fd-4b07-af38-8ac6013668fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:49.474205 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6e2ec4ab-e8fd-4b07-af38-8ac6013668fd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1744 microversion: 2.20 time: 0.185040 Jan 19 13:12:49.474762 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 544/1099] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:49 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:49.698475 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3a8152b3-7cad-4af1-97ac-9f55bafc5576 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:49.699417 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3a8152b3-7cad-4af1-97ac-9f55bafc5576 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:49.705693 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3a8152b3-7cad-4af1-97ac-9f55bafc5576 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:49.706173 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3a8152b3-7cad-4af1-97ac-9f55bafc5576 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:49.706982 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3a8152b3-7cad-4af1-97ac-9f55bafc5576 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:49.707422 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3a8152b3-7cad-4af1-97ac-9f55bafc5576 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:49.768887 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3a8152b3-7cad-4af1-97ac-9f55bafc5576 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.075401 Jan 19 13:12:49.769515 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 556/1100] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:49 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:50.492166 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-16e2a9ce-ba85-40dc-899d-d164b19a5cd7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:50.492769 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-16e2a9ce-ba85-40dc-899d-d164b19a5cd7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:50.499034 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-16e2a9ce-ba85-40dc-899d-d164b19a5cd7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:50.499483 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-16e2a9ce-ba85-40dc-899d-d164b19a5cd7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:50.500282 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-16e2a9ce-ba85-40dc-899d-d164b19a5cd7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:50.500714 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-16e2a9ce-ba85-40dc-899d-d164b19a5cd7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:50.630328 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-16e2a9ce-ba85-40dc-899d-d164b19a5cd7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:50.638517 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-16e2a9ce-ba85-40dc-899d-d164b19a5cd7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:50.640240 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-16e2a9ce-ba85-40dc-899d-d164b19a5cd7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:50.641386 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-16e2a9ce-ba85-40dc-899d-d164b19a5cd7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1744 microversion: 2.20 time: 0.153055 Jan 19 13:12:50.641949 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 545/1101] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:50 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:50.781120 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-708d4c6d-3511-4567-abce-c9abe49fea9b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:50.782218 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-708d4c6d-3511-4567-abce-c9abe49fea9b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:50.789035 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-708d4c6d-3511-4567-abce-c9abe49fea9b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:50.789483 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-708d4c6d-3511-4567-abce-c9abe49fea9b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:50.790255 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-708d4c6d-3511-4567-abce-c9abe49fea9b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:50.790685 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-708d4c6d-3511-4567-abce-c9abe49fea9b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:50.849081 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-708d4c6d-3511-4567-abce-c9abe49fea9b tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.071939 Jan 19 13:12:50.853199 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 557/1102] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:50 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:51.660161 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-21cd5c80-adb8-4dc1-a0dd-07716e0d11ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:51.660804 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-21cd5c80-adb8-4dc1-a0dd-07716e0d11ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:51.669688 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-21cd5c80-adb8-4dc1-a0dd-07716e0d11ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:51.671468 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-21cd5c80-adb8-4dc1-a0dd-07716e0d11ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:51.672559 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-21cd5c80-adb8-4dc1-a0dd-07716e0d11ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:51.673234 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-21cd5c80-adb8-4dc1-a0dd-07716e0d11ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:51.813335 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-21cd5c80-adb8-4dc1-a0dd-07716e0d11ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:51.823045 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-21cd5c80-adb8-4dc1-a0dd-07716e0d11ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:51.824805 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-21cd5c80-adb8-4dc1-a0dd-07716e0d11ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:51.826144 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-21cd5c80-adb8-4dc1-a0dd-07716e0d11ab tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1739 microversion: 2.20 time: 0.169759 Jan 19 13:12:51.827025 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 546/1103] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:51 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:51.861410 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7f7e6973-e030-4f6a-a412-c6c9e79bea37 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:51.863739 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7f7e6973-e030-4f6a-a412-c6c9e79bea37 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:51.872751 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f7e6973-e030-4f6a-a412-c6c9e79bea37 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:51.873285 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f7e6973-e030-4f6a-a412-c6c9e79bea37 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:51.874153 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f7e6973-e030-4f6a-a412-c6c9e79bea37 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:51.874700 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7f7e6973-e030-4f6a-a412-c6c9e79bea37 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:51.953904 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7f7e6973-e030-4f6a-a412-c6c9e79bea37 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.096292 Jan 19 13:12:51.957844 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 558/1104] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:51 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:52.844855 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-758e8af3-ff2d-44cd-b0dd-81a764f824e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:52.845446 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-758e8af3-ff2d-44cd-b0dd-81a764f824e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:52.852717 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-758e8af3-ff2d-44cd-b0dd-81a764f824e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:52.853450 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-758e8af3-ff2d-44cd-b0dd-81a764f824e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:52.854470 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-758e8af3-ff2d-44cd-b0dd-81a764f824e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:52.854963 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-758e8af3-ff2d-44cd-b0dd-81a764f824e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:52.966135 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-48078d98-8c1c-4327-a15b-9edbdade7d2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:52.967159 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-48078d98-8c1c-4327-a15b-9edbdade7d2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:52.974508 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-48078d98-8c1c-4327-a15b-9edbdade7d2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:52.975818 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-48078d98-8c1c-4327-a15b-9edbdade7d2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:52.976853 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-48078d98-8c1c-4327-a15b-9edbdade7d2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:52.977515 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-48078d98-8c1c-4327-a15b-9edbdade7d2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:53.000205 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-758e8af3-ff2d-44cd-b0dd-81a764f824e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:53.010629 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-758e8af3-ff2d-44cd-b0dd-81a764f824e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:53.012167 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-758e8af3-ff2d-44cd-b0dd-81a764f824e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:53.013333 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-758e8af3-ff2d-44cd-b0dd-81a764f824e1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1739 microversion: 2.20 time: 0.172105 Jan 19 13:12:53.013892 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 547/1105] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:52 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:12:53.043395 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-48078d98-8c1c-4327-a15b-9edbdade7d2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.081138 Jan 19 13:12:53.044270 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 559/1106] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:52 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:12:54.035028 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-1ca78dfd-50af-4d81-b9f8-aa87346fee26 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:54.035568 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-1ca78dfd-50af-4d81-b9f8-aa87346fee26 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:54.042576 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1ca78dfd-50af-4d81-b9f8-aa87346fee26 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:54.043037 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1ca78dfd-50af-4d81-b9f8-aa87346fee26 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:54.043820 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1ca78dfd-50af-4d81-b9f8-aa87346fee26 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:54.044570 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1ca78dfd-50af-4d81-b9f8-aa87346fee26 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:54.057485 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1abdac39-43d0-41e5-a425-3a5511dbfd05 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:54.059290 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1abdac39-43d0-41e5-a425-3a5511dbfd05 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:54.067784 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1abdac39-43d0-41e5-a425-3a5511dbfd05 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:54.068671 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1abdac39-43d0-41e5-a425-3a5511dbfd05 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:54.069773 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1abdac39-43d0-41e5-a425-3a5511dbfd05 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:54.070502 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1abdac39-43d0-41e5-a425-3a5511dbfd05 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:54.142355 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1abdac39-43d0-41e5-a425-3a5511dbfd05 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.090305 Jan 19 13:12:54.143913 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 560/1107] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:54 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:54.236214 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-1ca78dfd-50af-4d81-b9f8-aa87346fee26 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:54.245223 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-1ca78dfd-50af-4d81-b9f8-aa87346fee26 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:54.246939 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-1ca78dfd-50af-4d81-b9f8-aa87346fee26 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:54.248190 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-1ca78dfd-50af-4d81-b9f8-aa87346fee26 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1739 microversion: 2.20 time: 0.218727 Jan 19 13:12:54.249098 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 548/1108] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:54 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:55.156352 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e5465f7e-a57b-4cb6-83c2-1657b660386f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:55.157481 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e5465f7e-a57b-4cb6-83c2-1657b660386f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:55.164244 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e5465f7e-a57b-4cb6-83c2-1657b660386f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:55.165320 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e5465f7e-a57b-4cb6-83c2-1657b660386f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:55.166359 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e5465f7e-a57b-4cb6-83c2-1657b660386f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:55.166875 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e5465f7e-a57b-4cb6-83c2-1657b660386f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:55.239072 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e5465f7e-a57b-4cb6-83c2-1657b660386f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.087592 Jan 19 13:12:55.239876 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 561/1109] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:55 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:55.266675 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-938ee121-31d9-4b54-ab0e-3c6cda077496 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:55.267440 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-938ee121-31d9-4b54-ab0e-3c6cda077496 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:55.273963 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-938ee121-31d9-4b54-ab0e-3c6cda077496 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:55.274460 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-938ee121-31d9-4b54-ab0e-3c6cda077496 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:55.275233 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-938ee121-31d9-4b54-ab0e-3c6cda077496 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:55.275686 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-938ee121-31d9-4b54-ab0e-3c6cda077496 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:55.429748 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-938ee121-31d9-4b54-ab0e-3c6cda077496 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:55.438857 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-938ee121-31d9-4b54-ab0e-3c6cda077496 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:55.441124 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-938ee121-31d9-4b54-ab0e-3c6cda077496 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:55.442372 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-938ee121-31d9-4b54-ab0e-3c6cda077496 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1739 microversion: 2.20 time: 0.179470 Jan 19 13:12:55.455955 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 549/1110] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:55 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:12:56.251297 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-256ac376-fc78-4ad6-aea8-1a6c3b431480 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:56.252249 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-256ac376-fc78-4ad6-aea8-1a6c3b431480 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:56.260514 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-256ac376-fc78-4ad6-aea8-1a6c3b431480 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:56.260974 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-256ac376-fc78-4ad6-aea8-1a6c3b431480 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:56.261768 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-256ac376-fc78-4ad6-aea8-1a6c3b431480 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:56.262212 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-256ac376-fc78-4ad6-aea8-1a6c3b431480 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:56.326446 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-256ac376-fc78-4ad6-aea8-1a6c3b431480 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 28692 microversion: 2.1 time: 0.079096 Jan 19 13:12:56.327369 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 562/1111] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:56 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 28692 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:56.462772 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ffa5ba0b-2da9-4af8-b547-f8577899b03d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:56.463388 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ffa5ba0b-2da9-4af8-b547-f8577899b03d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:56.472831 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ffa5ba0b-2da9-4af8-b547-f8577899b03d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:56.473686 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ffa5ba0b-2da9-4af8-b547-f8577899b03d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:56.475248 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ffa5ba0b-2da9-4af8-b547-f8577899b03d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:56.476215 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ffa5ba0b-2da9-4af8-b547-f8577899b03d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:56.636502 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ffa5ba0b-2da9-4af8-b547-f8577899b03d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:56.649721 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ffa5ba0b-2da9-4af8-b547-f8577899b03d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:56.651692 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ffa5ba0b-2da9-4af8-b547-f8577899b03d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:56.653210 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ffa5ba0b-2da9-4af8-b547-f8577899b03d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1739 microversion: 2.20 time: 0.194912 Jan 19 13:12:56.654062 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 550/1112] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:56 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:57.338789 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3627fbd3-b9b8-4826-9b74-7b570dc76f88 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:57.340511 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3627fbd3-b9b8-4826-9b74-7b570dc76f88 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:57.347709 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3627fbd3-b9b8-4826-9b74-7b570dc76f88 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:57.348207 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3627fbd3-b9b8-4826-9b74-7b570dc76f88 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:57.349046 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3627fbd3-b9b8-4826-9b74-7b570dc76f88 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:57.349438 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3627fbd3-b9b8-4826-9b74-7b570dc76f88 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:57.436829 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3627fbd3-b9b8-4826-9b74-7b570dc76f88 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 29253 microversion: 2.1 time: 0.102539 Jan 19 13:12:57.438919 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 563/1113] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:57 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 29253 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:57.672311 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d839307b-6a5d-4150-ab85-e9eec63c2297 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:57.672856 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d839307b-6a5d-4150-ab85-e9eec63c2297 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:57.678772 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d839307b-6a5d-4150-ab85-e9eec63c2297 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:57.679307 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d839307b-6a5d-4150-ab85-e9eec63c2297 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:57.680208 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d839307b-6a5d-4150-ab85-e9eec63c2297 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:57.680736 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d839307b-6a5d-4150-ab85-e9eec63c2297 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:57.826356 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d839307b-6a5d-4150-ab85-e9eec63c2297 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:57.834859 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d839307b-6a5d-4150-ab85-e9eec63c2297 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:57.836460 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d839307b-6a5d-4150-ab85-e9eec63c2297 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:57.837972 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d839307b-6a5d-4150-ab85-e9eec63c2297 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1739 microversion: 2.20 time: 0.170117 Jan 19 13:12:57.848766 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 551/1114] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:57 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:12:58.454030 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6e703705-0f17-43a3-93cf-b66201c80d74 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:58.455727 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6e703705-0f17-43a3-93cf-b66201c80d74 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:58.465026 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6e703705-0f17-43a3-93cf-b66201c80d74 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:58.465685 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6e703705-0f17-43a3-93cf-b66201c80d74 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:58.466482 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6e703705-0f17-43a3-93cf-b66201c80d74 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:58.466920 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6e703705-0f17-43a3-93cf-b66201c80d74 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:58.550332 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6e703705-0f17-43a3-93cf-b66201c80d74 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 31369 microversion: 2.1 time: 0.102165 Jan 19 13:12:58.551032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 564/1115] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:58 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 31369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:12:58.857205 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f253960d-000b-477c-b3e1-e82f517a521d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:12:58.858408 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f253960d-000b-477c-b3e1-e82f517a521d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:58.865148 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f253960d-000b-477c-b3e1-e82f517a521d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:58.865597 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f253960d-000b-477c-b3e1-e82f517a521d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:58.866607 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f253960d-000b-477c-b3e1-e82f517a521d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:58.867848 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f253960d-000b-477c-b3e1-e82f517a521d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:59.023922 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f253960d-000b-477c-b3e1-e82f517a521d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:59.032838 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f253960d-000b-477c-b3e1-e82f517a521d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:59.034449 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f253960d-000b-477c-b3e1-e82f517a521d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:12:59.035966 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f253960d-000b-477c-b3e1-e82f517a521d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1739 microversion: 2.20 time: 0.183987 Jan 19 13:12:59.036756 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 552/1116] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:12:58 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:12:59.570407 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2c91d027-449d-410e-b513-b987f4f87408 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:12:59.572324 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2c91d027-449d-410e-b513-b987f4f87408 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:12:59.587828 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2c91d027-449d-410e-b513-b987f4f87408 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:59.588384 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2c91d027-449d-410e-b513-b987f4f87408 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:59.589464 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2c91d027-449d-410e-b513-b987f4f87408 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:12:59.590314 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2c91d027-449d-410e-b513-b987f4f87408 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:12:59.669832 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2c91d027-449d-410e-b513-b987f4f87408 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 33022 microversion: 2.1 time: 0.103582 Jan 19 13:12:59.674879 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 565/1117] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:12:59 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 33022 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:13:00.067039 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3bd03c95-7f4d-4ea1-8df3-fbd2cae60565 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:00.067680 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3bd03c95-7f4d-4ea1-8df3-fbd2cae60565 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:00.076764 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3bd03c95-7f4d-4ea1-8df3-fbd2cae60565 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:00.077881 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3bd03c95-7f4d-4ea1-8df3-fbd2cae60565 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:00.078650 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3bd03c95-7f4d-4ea1-8df3-fbd2cae60565 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:00.082584 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3bd03c95-7f4d-4ea1-8df3-fbd2cae60565 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:00.227640 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3bd03c95-7f4d-4ea1-8df3-fbd2cae60565 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:00.235843 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3bd03c95-7f4d-4ea1-8df3-fbd2cae60565 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:00.237416 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3bd03c95-7f4d-4ea1-8df3-fbd2cae60565 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:00.238605 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3bd03c95-7f4d-4ea1-8df3-fbd2cae60565 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1739 microversion: 2.20 time: 0.186575 Jan 19 13:13:00.250070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 553/1118] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:00 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:13:00.684146 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4940c5a9-b469-4faf-ad14-e1fe8283cf53 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:00.685154 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4940c5a9-b469-4faf-ad14-e1fe8283cf53 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:00.692265 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4940c5a9-b469-4faf-ad14-e1fe8283cf53 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:00.692715 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4940c5a9-b469-4faf-ad14-e1fe8283cf53 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:00.696142 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4940c5a9-b469-4faf-ad14-e1fe8283cf53 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:00.696597 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4940c5a9-b469-4faf-ad14-e1fe8283cf53 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:00.782868 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4940c5a9-b469-4faf-ad14-e1fe8283cf53 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 33987 microversion: 2.1 time: 0.103682 Jan 19 13:13:00.784534 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 566/1119] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:13:00 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 33987 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:13:01.257638 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-092204ad-4d54-40fa-b894-b4c3c4c8a075 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:01.258990 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-092204ad-4d54-40fa-b894-b4c3c4c8a075 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:01.265407 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-092204ad-4d54-40fa-b894-b4c3c4c8a075 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:01.265891 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-092204ad-4d54-40fa-b894-b4c3c4c8a075 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:01.267827 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-092204ad-4d54-40fa-b894-b4c3c4c8a075 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:01.268036 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-092204ad-4d54-40fa-b894-b4c3c4c8a075 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:01.402169 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-092204ad-4d54-40fa-b894-b4c3c4c8a075 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:01.409809 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-092204ad-4d54-40fa-b894-b4c3c4c8a075 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:01.411484 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-092204ad-4d54-40fa-b894-b4c3c4c8a075 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:01.412684 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-092204ad-4d54-40fa-b894-b4c3c4c8a075 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1739 microversion: 2.20 time: 0.159075 Jan 19 13:13:01.413248 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 554/1120] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:01 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:13:01.795563 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3def7616-014f-41f6-a3b9-4fdc624a0c76 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:01.796598 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3def7616-014f-41f6-a3b9-4fdc624a0c76 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:01.803473 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3def7616-014f-41f6-a3b9-4fdc624a0c76 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:01.803928 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3def7616-014f-41f6-a3b9-4fdc624a0c76 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:01.805219 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3def7616-014f-41f6-a3b9-4fdc624a0c76 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:01.805948 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3def7616-014f-41f6-a3b9-4fdc624a0c76 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:01.982173 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3def7616-014f-41f6-a3b9-4fdc624a0c76 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 35249 microversion: 2.1 time: 0.190660 Jan 19 13:13:01.983156 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 567/1121] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:13:01 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 35249 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:13:02.430367 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-dce89b46-3478-4dd0-8372-7e5097ff957b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:02.431017 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-dce89b46-3478-4dd0-8372-7e5097ff957b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:02.437542 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dce89b46-3478-4dd0-8372-7e5097ff957b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:02.438001 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dce89b46-3478-4dd0-8372-7e5097ff957b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:02.438791 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dce89b46-3478-4dd0-8372-7e5097ff957b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:02.439232 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-dce89b46-3478-4dd0-8372-7e5097ff957b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:02.680626 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-dce89b46-3478-4dd0-8372-7e5097ff957b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:02.688315 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-dce89b46-3478-4dd0-8372-7e5097ff957b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:02.689824 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-dce89b46-3478-4dd0-8372-7e5097ff957b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:02.690975 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-dce89b46-3478-4dd0-8372-7e5097ff957b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1721 microversion: 2.20 time: 0.264473 Jan 19 13:13:02.691586 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 555/1122] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:02 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:13:02.995493 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-753a012a-6f4f-4cec-95d5-97944969946c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:02.996428 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-753a012a-6f4f-4cec-95d5-97944969946c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:03.003271 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-753a012a-6f4f-4cec-95d5-97944969946c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:03.003719 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-753a012a-6f4f-4cec-95d5-97944969946c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:03.004526 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-753a012a-6f4f-4cec-95d5-97944969946c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:03.004963 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-753a012a-6f4f-4cec-95d5-97944969946c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:03.076562 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-753a012a-6f4f-4cec-95d5-97944969946c tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 36555 microversion: 2.1 time: 0.085946 Jan 19 13:13:03.077189 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 568/1123] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:13:02 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 36555 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:13:03.710292 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7fc0e15e-80a7-4a5c-baec-1b0ce1c4e522 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:03.710976 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7fc0e15e-80a7-4a5c-baec-1b0ce1c4e522 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:03.718583 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fc0e15e-80a7-4a5c-baec-1b0ce1c4e522 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:03.719023 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fc0e15e-80a7-4a5c-baec-1b0ce1c4e522 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:03.719811 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fc0e15e-80a7-4a5c-baec-1b0ce1c4e522 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:03.720290 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7fc0e15e-80a7-4a5c-baec-1b0ce1c4e522 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:03.851446 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7fc0e15e-80a7-4a5c-baec-1b0ce1c4e522 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:03.860042 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7fc0e15e-80a7-4a5c-baec-1b0ce1c4e522 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:03.861604 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7fc0e15e-80a7-4a5c-baec-1b0ce1c4e522 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:03.862766 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7fc0e15e-80a7-4a5c-baec-1b0ce1c4e522 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1721 microversion: 2.20 time: 0.156170 Jan 19 13:13:03.863332 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 556/1124] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:03 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:13:04.089697 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-81f69504-fb2f-4cb9-b6c2-5955e32ed25e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:04.090710 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-81f69504-fb2f-4cb9-b6c2-5955e32ed25e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:04.097592 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-81f69504-fb2f-4cb9-b6c2-5955e32ed25e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:04.098049 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-81f69504-fb2f-4cb9-b6c2-5955e32ed25e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:04.098828 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-81f69504-fb2f-4cb9-b6c2-5955e32ed25e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:04.099270 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-81f69504-fb2f-4cb9-b6c2-5955e32ed25e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:04.283179 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-81f69504-fb2f-4cb9-b6c2-5955e32ed25e tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 38065 microversion: 2.1 time: 0.198111 Jan 19 13:13:04.283855 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 569/1125] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:13:04 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 38065 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:13:04.881759 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4c0039e8-fdff-4af8-aefe-43fd2e33a4c5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:04.882551 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4c0039e8-fdff-4af8-aefe-43fd2e33a4c5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:04.890214 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c0039e8-fdff-4af8-aefe-43fd2e33a4c5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:04.890715 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c0039e8-fdff-4af8-aefe-43fd2e33a4c5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:04.891507 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c0039e8-fdff-4af8-aefe-43fd2e33a4c5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:04.891946 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4c0039e8-fdff-4af8-aefe-43fd2e33a4c5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:05.029951 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4c0039e8-fdff-4af8-aefe-43fd2e33a4c5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:05.037667 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4c0039e8-fdff-4af8-aefe-43fd2e33a4c5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:05.039670 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4c0039e8-fdff-4af8-aefe-43fd2e33a4c5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:05.041029 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4c0039e8-fdff-4af8-aefe-43fd2e33a4c5 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1724 microversion: 2.20 time: 0.163143 Jan 19 13:13:05.041583 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 557/1126] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:04 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:13:05.059559 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1f3157e5-7227-4725-a281-ce20299377bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05a18dd8-dc69-461e-876c-85b9196aa2a5"}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:05.060762 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1f3157e5-7227-4725-a281-ce20299377bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:05.067532 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1f3157e5-7227-4725-a281-ce20299377bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:05.067957 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1f3157e5-7227-4725-a281-ce20299377bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:05.068748 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1f3157e5-7227-4725-a281-ce20299377bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:05.069182 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1f3157e5-7227-4725-a281-ce20299377bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:05.295331 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0fb2f439-32b7-4b64-b77b-c6cb07150acb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:05.296368 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0fb2f439-32b7-4b64-b77b-c6cb07150acb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:05.302690 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0fb2f439-32b7-4b64-b77b-c6cb07150acb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:05.303240 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0fb2f439-32b7-4b64-b77b-c6cb07150acb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:05.304729 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0fb2f439-32b7-4b64-b77b-c6cb07150acb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:05.305544 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0fb2f439-32b7-4b64-b77b-c6cb07150acb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:05.321670 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1f3157e5-7227-4725-a281-ce20299377bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.267002 Jan 19 13:13:05.327077 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 570/1127] 10.222.0.48 () {62 vars in 1363 bytes} [Wed Jan 19 13:13:05 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/os-volume_attachments => generated 188 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:13:05.367686 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-319ecf9a-0fbe-4e89-a034-1909f70aac3d req-691fd899-fe28-485f-b42d-83588870aef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d2bd3e-47a3-4158-892e-627b3f1c1095", "name": "network-vif-unplugged", "status": "completed", "tag": "e6862281-58ef-4013-962c-3a0024140b3a"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:05.369569 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:13:05.369569 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:13:05.381187 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0fb2f439-32b7-4b64-b77b-c6cb07150acb tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 38226 microversion: 2.1 time: 0.089323 Jan 19 13:13:05.382503 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 558/1128] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:13:05 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 38226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:13:05.385882 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-319ecf9a-0fbe-4e89-a034-1909f70aac3d req-691fd899-fe28-485f-b42d-83588870aef3 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:05.386668 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-319ecf9a-0fbe-4e89-a034-1909f70aac3d req-691fd899-fe28-485f-b42d-83588870aef3 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:05.399537 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.compute.server_external_events [req-319ecf9a-0fbe-4e89-a034-1909f70aac3d req-691fd899-fe28-485f-b42d-83588870aef3 service nova] Unable to find a host for instance 16d2bd3e-47a3-4158-892e-627b3f1c1095. Dropping event network-vif-unplugged {{(pid=116361) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 19 13:13:05.400441 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-319ecf9a-0fbe-4e89-a034-1909f70aac3d req-691fd899-fe28-485f-b42d-83588870aef3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037072 Jan 19 13:13:05.401025 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 571/1129] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 19 13:13:05.440762 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7050532c-d75f-4bd7-ad98-7bd1d55e6ebe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:05.441349 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7050532c-d75f-4bd7-ad98-7bd1d55e6ebe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:05.449157 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7050532c-d75f-4bd7-ad98-7bd1d55e6ebe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:05.449615 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7050532c-d75f-4bd7-ad98-7bd1d55e6ebe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:05.450396 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7050532c-d75f-4bd7-ad98-7bd1d55e6ebe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:05.450837 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7050532c-d75f-4bd7-ad98-7bd1d55e6ebe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:05.676864 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7050532c-d75f-4bd7-ad98-7bd1d55e6ebe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "DELETE /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/os-volume_attachments/05a18dd8-dc69-461e-876c-85b9196aa2a5" status: 202 len: 0 microversion: 2.20 time: 0.240115 Jan 19 13:13:05.677824 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 559/1130] 10.222.0.48 () {60 vars in 1456 bytes} [Wed Jan 19 13:13:05 2022] DELETE /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/os-volume_attachments/05a18dd8-dc69-461e-876c-85b9196aa2a5 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:13:05.735325 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e6bd6d7f-3179-4b05-9dbe-7cb2d1f1dad1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:05.735880 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e6bd6d7f-3179-4b05-9dbe-7cb2d1f1dad1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:05.742805 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e6bd6d7f-3179-4b05-9dbe-7cb2d1f1dad1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:05.743309 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e6bd6d7f-3179-4b05-9dbe-7cb2d1f1dad1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:05.744105 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e6bd6d7f-3179-4b05-9dbe-7cb2d1f1dad1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:05.744542 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e6bd6d7f-3179-4b05-9dbe-7cb2d1f1dad1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:05.834209 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e6bd6d7f-3179-4b05-9dbe-7cb2d1f1dad1 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action" status: 202 len: 0 microversion: 2.20 time: 0.102633 Jan 19 13:13:05.834811 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 572/1131] 10.222.0.48 () {62 vars in 1318 bytes} [Wed Jan 19 13:13:05 2022] POST /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:13:05.842797 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-349daa98-481d-4819-a312-12b33548ae8d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:05.843413 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-349daa98-481d-4819-a312-12b33548ae8d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:05.849892 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-349daa98-481d-4819-a312-12b33548ae8d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:05.850350 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-349daa98-481d-4819-a312-12b33548ae8d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:05.851140 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-349daa98-481d-4819-a312-12b33548ae8d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:05.852562 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-349daa98-481d-4819-a312-12b33548ae8d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:05.985647 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-349daa98-481d-4819-a312-12b33548ae8d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:05.995243 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-349daa98-481d-4819-a312-12b33548ae8d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:05.996787 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-349daa98-481d-4819-a312-12b33548ae8d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:05.998109 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-349daa98-481d-4819-a312-12b33548ae8d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1672 microversion: 2.20 time: 0.158911 Jan 19 13:13:05.998825 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 560/1132] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:05 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:13:06.394560 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-33ffa726-285f-43c7-b240-283406e9a220 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:06.395471 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-33ffa726-285f-43c7-b240-283406e9a220 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:06.403297 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33ffa726-285f-43c7-b240-283406e9a220 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:06.403790 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33ffa726-285f-43c7-b240-283406e9a220 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:06.404562 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33ffa726-285f-43c7-b240-283406e9a220 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:06.404997 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33ffa726-285f-43c7-b240-283406e9a220 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:06.465407 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-33ffa726-285f-43c7-b240-283406e9a220 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 38226 microversion: 2.1 time: 0.074818 Jan 19 13:13:06.466068 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 573/1133] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:13:06 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 38226 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:13:07.017222 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-902032ad-55c2-44ff-823e-f411cbc24cd4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:07.017865 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-902032ad-55c2-44ff-823e-f411cbc24cd4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:07.024814 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-902032ad-55c2-44ff-823e-f411cbc24cd4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:07.025265 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-902032ad-55c2-44ff-823e-f411cbc24cd4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:07.026055 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-902032ad-55c2-44ff-823e-f411cbc24cd4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:07.026497 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-902032ad-55c2-44ff-823e-f411cbc24cd4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:07.479348 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b52bd45c-8ce9-4da5-9010-75e55f9966f1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:07.480154 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b52bd45c-8ce9-4da5-9010-75e55f9966f1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:07.487123 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b52bd45c-8ce9-4da5-9010-75e55f9966f1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:07.487577 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b52bd45c-8ce9-4da5-9010-75e55f9966f1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:07.488438 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b52bd45c-8ce9-4da5-9010-75e55f9966f1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:07.488863 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b52bd45c-8ce9-4da5-9010-75e55f9966f1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:07.494287 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-902032ad-55c2-44ff-823e-f411cbc24cd4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:07.517353 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-902032ad-55c2-44ff-823e-f411cbc24cd4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:07.518921 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-902032ad-55c2-44ff-823e-f411cbc24cd4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:07.520378 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-902032ad-55c2-44ff-823e-f411cbc24cd4 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.507326 Jan 19 13:13:07.520945 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 561/1134] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:07 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:13:07.549094 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b52bd45c-8ce9-4da5-9010-75e55f9966f1 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 38226 microversion: 2.1 time: 0.074787 Jan 19 13:13:07.550214 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 574/1135] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:13:07 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 38226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 13:13:08.540798 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-bef7ed64-8bdb-442c-8ed4-5473e64169dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:08.541434 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-bef7ed64-8bdb-442c-8ed4-5473e64169dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:08.549082 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bef7ed64-8bdb-442c-8ed4-5473e64169dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:08.549636 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bef7ed64-8bdb-442c-8ed4-5473e64169dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:08.550439 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bef7ed64-8bdb-442c-8ed4-5473e64169dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:08.550881 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bef7ed64-8bdb-442c-8ed4-5473e64169dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:08.561962 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-33b90143-efc9-4a2a-9586-ed1e6d04cc05 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:08.564282 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-33b90143-efc9-4a2a-9586-ed1e6d04cc05 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:08.573342 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33b90143-efc9-4a2a-9586-ed1e6d04cc05 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:08.573812 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33b90143-efc9-4a2a-9586-ed1e6d04cc05 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:08.574688 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33b90143-efc9-4a2a-9586-ed1e6d04cc05 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:08.575204 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33b90143-efc9-4a2a-9586-ed1e6d04cc05 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:08.696881 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bef7ed64-8bdb-442c-8ed4-5473e64169dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:08.704975 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bef7ed64-8bdb-442c-8ed4-5473e64169dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:08.706473 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bef7ed64-8bdb-442c-8ed4-5473e64169dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:08.707631 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-bef7ed64-8bdb-442c-8ed4-5473e64169dd tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.171287 Jan 19 13:13:08.708550 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 562/1136] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:08 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:13:09.726661 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-da5d7fda-d44d-45e5-8a98-a06a45f15218 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:09.727339 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-da5d7fda-d44d-45e5-8a98-a06a45f15218 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:09.733617 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da5d7fda-d44d-45e5-8a98-a06a45f15218 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:09.734070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da5d7fda-d44d-45e5-8a98-a06a45f15218 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:09.734873 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da5d7fda-d44d-45e5-8a98-a06a45f15218 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:09.735310 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da5d7fda-d44d-45e5-8a98-a06a45f15218 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:09.875679 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-da5d7fda-d44d-45e5-8a98-a06a45f15218 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:09.886049 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-da5d7fda-d44d-45e5-8a98-a06a45f15218 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:09.887605 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-da5d7fda-d44d-45e5-8a98-a06a45f15218 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:09.888872 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-da5d7fda-d44d-45e5-8a98-a06a45f15218 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.165986 Jan 19 13:13:09.889436 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 563/1137] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:09 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:13:10.906551 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-63c204cf-95dd-458e-95ce-00d4d4379ce0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:10.907484 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-63c204cf-95dd-458e-95ce-00d4d4379ce0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:10.914997 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-63c204cf-95dd-458e-95ce-00d4d4379ce0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:10.915533 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-63c204cf-95dd-458e-95ce-00d4d4379ce0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:10.916654 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-63c204cf-95dd-458e-95ce-00d4d4379ce0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:10.917222 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-63c204cf-95dd-458e-95ce-00d4d4379ce0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:11.055781 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-63c204cf-95dd-458e-95ce-00d4d4379ce0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:11.066507 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-63c204cf-95dd-458e-95ce-00d4d4379ce0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:11.068163 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-63c204cf-95dd-458e-95ce-00d4d4379ce0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:11.069415 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-63c204cf-95dd-458e-95ce-00d4d4379ce0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.166577 Jan 19 13:13:11.070118 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 564/1138] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:10 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:13:12.087349 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-26b324fa-4345-4a85-aab4-d0023e95fe89 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:12.088057 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-26b324fa-4345-4a85-aab4-d0023e95fe89 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:12.094295 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-26b324fa-4345-4a85-aab4-d0023e95fe89 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:12.094748 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-26b324fa-4345-4a85-aab4-d0023e95fe89 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:12.095523 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-26b324fa-4345-4a85-aab4-d0023e95fe89 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:12.095962 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-26b324fa-4345-4a85-aab4-d0023e95fe89 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:12.227143 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-26b324fa-4345-4a85-aab4-d0023e95fe89 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:12.234868 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-26b324fa-4345-4a85-aab4-d0023e95fe89 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:12.236412 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-26b324fa-4345-4a85-aab4-d0023e95fe89 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:12.237571 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-26b324fa-4345-4a85-aab4-d0023e95fe89 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.154022 Jan 19 13:13:12.238133 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 565/1139] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:12 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:13:13.256853 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9163eca3-59dd-450d-8aa5-5155e8a3e366 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:13.259006 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9163eca3-59dd-450d-8aa5-5155e8a3e366 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:13.264867 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9163eca3-59dd-450d-8aa5-5155e8a3e366 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:13.265322 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9163eca3-59dd-450d-8aa5-5155e8a3e366 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:13.266136 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9163eca3-59dd-450d-8aa5-5155e8a3e366 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:13.266564 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9163eca3-59dd-450d-8aa5-5155e8a3e366 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:13.406123 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-9163eca3-59dd-450d-8aa5-5155e8a3e366 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:13.414640 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-9163eca3-59dd-450d-8aa5-5155e8a3e366 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:13.416406 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-9163eca3-59dd-450d-8aa5-5155e8a3e366 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:13.417578 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9163eca3-59dd-450d-8aa5-5155e8a3e366 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.164562 Jan 19 13:13:13.418145 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 566/1140] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:13 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:13:14.435409 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ff6015f5-63ce-4460-9f88-14ad8025fa4b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:14.436090 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ff6015f5-63ce-4460-9f88-14ad8025fa4b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:14.442451 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff6015f5-63ce-4460-9f88-14ad8025fa4b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:14.442885 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff6015f5-63ce-4460-9f88-14ad8025fa4b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:14.443676 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff6015f5-63ce-4460-9f88-14ad8025fa4b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:14.444149 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ff6015f5-63ce-4460-9f88-14ad8025fa4b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:14.577012 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ff6015f5-63ce-4460-9f88-14ad8025fa4b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:14.585077 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ff6015f5-63ce-4460-9f88-14ad8025fa4b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:14.586765 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ff6015f5-63ce-4460-9f88-14ad8025fa4b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:14.587918 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ff6015f5-63ce-4460-9f88-14ad8025fa4b tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.156302 Jan 19 13:13:14.588512 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 567/1141] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:14 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:13:15.606707 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-389ec811-8f98-447c-812d-f0279f6f016a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:15.607392 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-389ec811-8f98-447c-812d-f0279f6f016a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:15.613747 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-389ec811-8f98-447c-812d-f0279f6f016a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:15.614201 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-389ec811-8f98-447c-812d-f0279f6f016a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:15.614988 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-389ec811-8f98-447c-812d-f0279f6f016a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:15.615423 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-389ec811-8f98-447c-812d-f0279f6f016a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:15.759003 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-389ec811-8f98-447c-812d-f0279f6f016a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:15.767747 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-389ec811-8f98-447c-812d-f0279f6f016a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:15.769307 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-389ec811-8f98-447c-812d-f0279f6f016a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:15.770573 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-389ec811-8f98-447c-812d-f0279f6f016a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.167615 Jan 19 13:13:15.771342 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 568/1142] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:15 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:13:16.788502 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3220529b-2446-4a93-be53-ad45c7d19990 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:16.790443 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3220529b-2446-4a93-be53-ad45c7d19990 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:16.796807 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3220529b-2446-4a93-be53-ad45c7d19990 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:16.797255 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3220529b-2446-4a93-be53-ad45c7d19990 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:16.798025 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3220529b-2446-4a93-be53-ad45c7d19990 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:16.798487 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3220529b-2446-4a93-be53-ad45c7d19990 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:16.938723 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3220529b-2446-4a93-be53-ad45c7d19990 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:16.948601 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3220529b-2446-4a93-be53-ad45c7d19990 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:16.950315 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3220529b-2446-4a93-be53-ad45c7d19990 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:16.951617 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3220529b-2446-4a93-be53-ad45c7d19990 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.166880 Jan 19 13:13:16.952205 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 569/1143] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:16 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:13:17.969924 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-9c7657f9-656d-4a59-a632-7fefc0dd8ed7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:17.970581 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-9c7657f9-656d-4a59-a632-7fefc0dd8ed7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:17.976895 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9c7657f9-656d-4a59-a632-7fefc0dd8ed7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:17.977346 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9c7657f9-656d-4a59-a632-7fefc0dd8ed7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:17.978129 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9c7657f9-656d-4a59-a632-7fefc0dd8ed7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:17.978566 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-9c7657f9-656d-4a59-a632-7fefc0dd8ed7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:18.108524 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-9c7657f9-656d-4a59-a632-7fefc0dd8ed7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:18.117118 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-9c7657f9-656d-4a59-a632-7fefc0dd8ed7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:18.119133 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-9c7657f9-656d-4a59-a632-7fefc0dd8ed7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:18.120322 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-9c7657f9-656d-4a59-a632-7fefc0dd8ed7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.154111 Jan 19 13:13:18.120876 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 570/1144] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:17 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:13:19.139313 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-43cf83ca-6fc6-44e0-bd14-dacf2cc55b10 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:19.139910 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-43cf83ca-6fc6-44e0-bd14-dacf2cc55b10 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:19.146130 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-43cf83ca-6fc6-44e0-bd14-dacf2cc55b10 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:19.146574 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-43cf83ca-6fc6-44e0-bd14-dacf2cc55b10 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:19.147366 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-43cf83ca-6fc6-44e0-bd14-dacf2cc55b10 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:19.147883 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-43cf83ca-6fc6-44e0-bd14-dacf2cc55b10 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:19.276420 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-43cf83ca-6fc6-44e0-bd14-dacf2cc55b10 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:19.284292 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-43cf83ca-6fc6-44e0-bd14-dacf2cc55b10 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:19.285834 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-43cf83ca-6fc6-44e0-bd14-dacf2cc55b10 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:19.286977 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-43cf83ca-6fc6-44e0-bd14-dacf2cc55b10 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.151365 Jan 19 13:13:19.287528 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 571/1145] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:19 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:13:20.278378 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-33b90143-efc9-4a2a-9586-ed1e6d04cc05 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action" status: 200 len: 38357 microversion: 2.1 time: 11.720402 Jan 19 13:13:20.279332 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 575/1146] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Jan 19 13:13:08 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/action => generated 38357 bytes in 11722 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 13:13:20.289808 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f8c6bfbc-2d8d-491c-bcd9-590a5636ce35 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:20.290310 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f8c6bfbc-2d8d-491c-bcd9-590a5636ce35 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:20.296655 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f8c6bfbc-2d8d-491c-bcd9-590a5636ce35 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:20.297105 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f8c6bfbc-2d8d-491c-bcd9-590a5636ce35 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:20.297880 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f8c6bfbc-2d8d-491c-bcd9-590a5636ce35 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:20.298325 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f8c6bfbc-2d8d-491c-bcd9-590a5636ce35 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:20.306602 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-fac182fe-3b66-4c4f-abd6-7134d66d9efe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:20.307303 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-fac182fe-3b66-4c4f-abd6-7134d66d9efe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:20.316335 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fac182fe-3b66-4c4f-abd6-7134d66d9efe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:20.316972 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fac182fe-3b66-4c4f-abd6-7134d66d9efe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:20.317802 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fac182fe-3b66-4c4f-abd6-7134d66d9efe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:20.318249 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fac182fe-3b66-4c4f-abd6-7134d66d9efe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:20.325152 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f8c6bfbc-2d8d-491c-bcd9-590a5636ce35 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/ips" status: 200 len: 146 microversion: 2.1 time: 0.039658 Jan 19 13:13:20.325748 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 572/1147] 10.222.0.48 () {58 vars in 1247 bytes} [Wed Jan 19 13:13:20 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:13:20.461865 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-fac182fe-3b66-4c4f-abd6-7134d66d9efe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:20.470290 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-fac182fe-3b66-4c4f-abd6-7134d66d9efe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:20.471791 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-fac182fe-3b66-4c4f-abd6-7134d66d9efe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:20.473013 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-fac182fe-3b66-4c4f-abd6-7134d66d9efe tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.171276 Jan 19 13:13:20.484695 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 576/1148] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:20 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:13:20.788805 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-604afe1c-642f-42de-a468-828442db4cf6 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:20.789296 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-604afe1c-642f-42de-a468-828442db4cf6 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:20.796237 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-604afe1c-642f-42de-a468-828442db4cf6 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:20.796237 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-604afe1c-642f-42de-a468-828442db4cf6 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:20.796861 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-604afe1c-642f-42de-a468-828442db4cf6 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:20.797302 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-604afe1c-642f-42de-a468-828442db4cf6 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:20.825955 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-604afe1c-642f-42de-a468-828442db4cf6 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Going to try to terminate instance {{(pid=116360) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:13:20.911237 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-604afe1c-642f-42de-a468-828442db4cf6 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 204 len: 0 microversion: 2.1 time: 0.126241 Jan 19 13:13:20.917021 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 573/1149] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:13:20 2022] DELETE /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:13:20.921647 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0d1224cc-ca47-4eb3-9840-e63bd780a94c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:20.922337 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0d1224cc-ca47-4eb3-9840-e63bd780a94c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:20.928240 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0d1224cc-ca47-4eb3-9840-e63bd780a94c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:20.928689 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0d1224cc-ca47-4eb3-9840-e63bd780a94c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:20.929532 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0d1224cc-ca47-4eb3-9840-e63bd780a94c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:20.929969 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0d1224cc-ca47-4eb3-9840-e63bd780a94c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:20.936977 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-3d9f855b-7d2a-49fa-af6e-661674928b51 req-021d6953-8531-409c-93b0-e60435f96f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ec4c20-aa67-4eef-b593-0387c00a3684", "tag": "d543cda5-e012-413e-a613-191a01247465"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:20.938742 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:13:20.938742 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:13:20.947215 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-3d9f855b-7d2a-49fa-af6e-661674928b51 req-021d6953-8531-409c-93b0-e60435f96f24 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:20.947861 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-3d9f855b-7d2a-49fa-af6e-661674928b51 req-021d6953-8531-409c-93b0-e60435f96f24 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:20.958242 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-3d9f855b-7d2a-49fa-af6e-661674928b51 req-021d6953-8531-409c-93b0-e60435f96f24 service nova] Creating event network-changed:d543cda5-e012-413e-a613-191a01247465 for instance f7ec4c20-aa67-4eef-b593-0387c00a3684 on hv-cinder-82301 Jan 19 13:13:20.964193 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-3d9f855b-7d2a-49fa-af6e-661674928b51 req-021d6953-8531-409c-93b0-e60435f96f24 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175471 Jan 19 13:13:20.964953 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 577/1150] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:13:21.172245 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-0d1224cc-ca47-4eb3-9840-e63bd780a94c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:21.180678 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0d1224cc-ca47-4eb3-9840-e63bd780a94c tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1568 microversion: 2.1 time: 0.263111 Jan 19 13:13:21.181364 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 574/1151] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:13:20 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1568 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:13:21.492797 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-30970ac8-1cae-4659-ad39-9e1f9d7c4264 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:21.493914 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-30970ac8-1cae-4659-ad39-9e1f9d7c4264 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:21.499511 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-30970ac8-1cae-4659-ad39-9e1f9d7c4264 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:21.499963 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-30970ac8-1cae-4659-ad39-9e1f9d7c4264 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:21.500982 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-30970ac8-1cae-4659-ad39-9e1f9d7c4264 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:21.501428 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-30970ac8-1cae-4659-ad39-9e1f9d7c4264 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:21.666513 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-199ee219-7543-4a07-af2f-42b613955af6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "749323b3-952f-4693-bd82-04f6949c86c7"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:21.667647 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-199ee219-7543-4a07-af2f-42b613955af6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:21.674212 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-199ee219-7543-4a07-af2f-42b613955af6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:21.674670 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-199ee219-7543-4a07-af2f-42b613955af6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:21.675462 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-199ee219-7543-4a07-af2f-42b613955af6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:21.675898 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-199ee219-7543-4a07-af2f-42b613955af6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:21.679852 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-30970ac8-1cae-4659-ad39-9e1f9d7c4264 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:21.697620 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-30970ac8-1cae-4659-ad39-9e1f9d7c4264 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:21.699155 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-30970ac8-1cae-4659-ad39-9e1f9d7c4264 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:21.701707 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-30970ac8-1cae-4659-ad39-9e1f9d7c4264 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.212680 Jan 19 13:13:21.708065 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 578/1152] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:21 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:13:21.950142 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-199ee219-7543-4a07-af2f-42b613955af6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287806 Jan 19 13:13:21.950781 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 575/1153] 10.222.0.48 () {60 vars in 1322 bytes} [Wed Jan 19 13:13:21 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:13:22.200308 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-416b01c6-1520-4042-b924-77c7123295e1 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:22.201360 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-416b01c6-1520-4042-b924-77c7123295e1 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:22.212400 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-416b01c6-1520-4042-b924-77c7123295e1 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:22.212881 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-416b01c6-1520-4042-b924-77c7123295e1 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:22.214827 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-416b01c6-1520-4042-b924-77c7123295e1 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:22.215308 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-416b01c6-1520-4042-b924-77c7123295e1 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:22.391351 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-416b01c6-1520-4042-b924-77c7123295e1 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:22.406217 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-416b01c6-1520-4042-b924-77c7123295e1 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1450 microversion: 2.1 time: 0.211882 Jan 19 13:13:22.406785 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 579/1154] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:13:22 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1450 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:13:22.720505 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2bdf0bdc-add4-4cae-b26a-e74727d48095 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:22.721100 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2bdf0bdc-add4-4cae-b26a-e74727d48095 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:22.728068 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2bdf0bdc-add4-4cae-b26a-e74727d48095 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:22.728530 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2bdf0bdc-add4-4cae-b26a-e74727d48095 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:22.729316 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2bdf0bdc-add4-4cae-b26a-e74727d48095 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:22.729756 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2bdf0bdc-add4-4cae-b26a-e74727d48095 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:22.925917 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2bdf0bdc-add4-4cae-b26a-e74727d48095 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:22.934836 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2bdf0bdc-add4-4cae-b26a-e74727d48095 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:22.936361 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2bdf0bdc-add4-4cae-b26a-e74727d48095 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:22.937508 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2bdf0bdc-add4-4cae-b26a-e74727d48095 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.221328 Jan 19 13:13:22.938056 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 576/1155] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:22 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:13:23.223002 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-e514b91c-ed72-4e3f-9d9c-be2cce0c4638 req-8933e0d6-e5b3-4906-8536-a071f8ea3198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ec4c20-aa67-4eef-b593-0387c00a3684", "name": "network-vif-deleted", "tag": "d543cda5-e012-413e-a613-191a01247465"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:23.224816 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:13:23.224816 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:13:23.233032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-e514b91c-ed72-4e3f-9d9c-be2cce0c4638 req-8933e0d6-e5b3-4906-8536-a071f8ea3198 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:23.233483 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-e514b91c-ed72-4e3f-9d9c-be2cce0c4638 req-8933e0d6-e5b3-4906-8536-a071f8ea3198 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:23.245067 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-e514b91c-ed72-4e3f-9d9c-be2cce0c4638 req-8933e0d6-e5b3-4906-8536-a071f8ea3198 service nova] Creating event network-vif-deleted:d543cda5-e012-413e-a613-191a01247465 for instance f7ec4c20-aa67-4eef-b593-0387c00a3684 on hv-cinder-82301 Jan 19 13:13:23.249644 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-e514b91c-ed72-4e3f-9d9c-be2cce0c4638 req-8933e0d6-e5b3-4906-8536-a071f8ea3198 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030358 Jan 19 13:13:23.250230 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 580/1156] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:13:23.422618 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-41fbd8d0-a499-4b38-b935-649ba9bd7f5d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:23.423471 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-41fbd8d0-a499-4b38-b935-649ba9bd7f5d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:23.429894 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-41fbd8d0-a499-4b38-b935-649ba9bd7f5d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:23.430493 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-41fbd8d0-a499-4b38-b935-649ba9bd7f5d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:23.431568 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-41fbd8d0-a499-4b38-b935-649ba9bd7f5d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:23.432027 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-41fbd8d0-a499-4b38-b935-649ba9bd7f5d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:23.504621 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-41fbd8d0-a499-4b38-b935-649ba9bd7f5d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78c8c1e6a2e47258c251260283d8314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cd5c7acaf1414c83c725421fc4f289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:23.513302 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-41fbd8d0-a499-4b38-b935-649ba9bd7f5d tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 200 len: 1219 microversion: 2.1 time: 0.094414 Jan 19 13:13:23.513841 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 577/1157] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:13:23 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:13:23.955182 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3d55e12b-9c81-4611-991c-2fc0141542bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:23.956297 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3d55e12b-9c81-4611-991c-2fc0141542bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:23.964727 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3d55e12b-9c81-4611-991c-2fc0141542bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:23.965381 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3d55e12b-9c81-4611-991c-2fc0141542bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:23.966410 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3d55e12b-9c81-4611-991c-2fc0141542bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:23.967042 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3d55e12b-9c81-4611-991c-2fc0141542bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:24.111002 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3d55e12b-9c81-4611-991c-2fc0141542bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:24.119441 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3d55e12b-9c81-4611-991c-2fc0141542bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:24.121007 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3d55e12b-9c81-4611-991c-2fc0141542bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:24.122165 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3d55e12b-9c81-4611-991c-2fc0141542bf tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.171252 Jan 19 13:13:24.122751 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 581/1158] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:23 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:13:24.529888 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-98d1313b-f43a-45bb-85f0-fdb5feeaa2d9 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:24.530486 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-98d1313b-f43a-45bb-85f0-fdb5feeaa2d9 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] [instance: f7ec4c20-aa67-4eef-b593-0387c00a3684] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:24.536742 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-98d1313b-f43a-45bb-85f0-fdb5feeaa2d9 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:24.537188 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-98d1313b-f43a-45bb-85f0-fdb5feeaa2d9 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:24.537955 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-98d1313b-f43a-45bb-85f0-fdb5feeaa2d9 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:24.539060 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-98d1313b-f43a-45bb-85f0-fdb5feeaa2d9 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:24.551940 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-98d1313b-f43a-45bb-85f0-fdb5feeaa2d9 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] HTTP exception thrown: Instance f7ec4c20-aa67-4eef-b593-0387c00a3684 could not be found. Jan 19 13:13:24.552543 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-98d1313b-f43a-45bb-85f0-fdb5feeaa2d9 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Returning 404 to user: Instance f7ec4c20-aa67-4eef-b593-0387c00a3684 could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:13:24.553338 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-98d1313b-f43a-45bb-85f0-fdb5feeaa2d9 tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684" status: 404 len: 111 microversion: 2.1 time: 0.027200 Jan 19 13:13:24.554510 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 578/1159] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:13:24 2022] GET /compute/v2.1/servers/f7ec4c20-aa67-4eef-b593-0387c00a3684 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:13:24.710080 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d768fd2b-96e8-45ba-b826-971d2d64c9cf tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] Calling method '.version_select at 0x7f07d7b1d4c0>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:24.730005 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d768fd2b-96e8-45ba-b826-971d2d64c9cf tempest-TestShelveInstance-156446255 tempest-TestShelveInstance-156446255-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-610852009" status: 202 len: 0 microversion: 2.1 time: 0.023717 Jan 19 13:13:24.730607 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 582/1160] 10.222.0.48 () {58 vars in 1250 bytes} [Wed Jan 19 13:13:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-610852009 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:13:25.141584 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6438b3f1-ed91-479e-bfcb-4264310c78dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:25.142193 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6438b3f1-ed91-479e-bfcb-4264310c78dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:25.157543 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6438b3f1-ed91-479e-bfcb-4264310c78dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:25.157998 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6438b3f1-ed91-479e-bfcb-4264310c78dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:25.158852 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6438b3f1-ed91-479e-bfcb-4264310c78dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:25.159318 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6438b3f1-ed91-479e-bfcb-4264310c78dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:25.412999 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6438b3f1-ed91-479e-bfcb-4264310c78dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:25.421312 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6438b3f1-ed91-479e-bfcb-4264310c78dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:25.422827 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6438b3f1-ed91-479e-bfcb-4264310c78dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:25.423998 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6438b3f1-ed91-479e-bfcb-4264310c78dc tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.286442 Jan 19 13:13:25.424878 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 579/1161] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:25 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:13:25.530843 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-1b3ede57-a757-4629-b1b1-cbf80f6b87a3 req-452de08b-c1f5-4ba6-be03-482c816b86df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d2bd3e-47a3-4158-892e-627b3f1c1095", "name": "network-vif-plugged", "status": "completed", "tag": "e6862281-58ef-4013-962c-3a0024140b3a"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:25.532531 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:13:25.532531 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:13:25.541038 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-1b3ede57-a757-4629-b1b1-cbf80f6b87a3 req-452de08b-c1f5-4ba6-be03-482c816b86df service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:25.541480 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-1b3ede57-a757-4629-b1b1-cbf80f6b87a3 req-452de08b-c1f5-4ba6-be03-482c816b86df service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:25.552644 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-1b3ede57-a757-4629-b1b1-cbf80f6b87a3 req-452de08b-c1f5-4ba6-be03-482c816b86df service nova] Creating event network-vif-plugged:e6862281-58ef-4013-962c-3a0024140b3a for instance 16d2bd3e-47a3-4158-892e-627b3f1c1095 on hv-cinder-82301 Jan 19 13:13:25.558607 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-1b3ede57-a757-4629-b1b1-cbf80f6b87a3 req-452de08b-c1f5-4ba6-be03-482c816b86df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031474 Jan 19 13:13:25.559213 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 583/1162] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:13:26.442663 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5dfb5fa9-84d6-4ae0-b931-9c9d27bb59a0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:26.443553 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5dfb5fa9-84d6-4ae0-b931-9c9d27bb59a0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:26.451153 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5dfb5fa9-84d6-4ae0-b931-9c9d27bb59a0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:26.451926 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5dfb5fa9-84d6-4ae0-b931-9c9d27bb59a0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:26.452817 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5dfb5fa9-84d6-4ae0-b931-9c9d27bb59a0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:26.453327 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5dfb5fa9-84d6-4ae0-b931-9c9d27bb59a0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:26.813663 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5dfb5fa9-84d6-4ae0-b931-9c9d27bb59a0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:26.822043 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5dfb5fa9-84d6-4ae0-b931-9c9d27bb59a0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:26.823540 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5dfb5fa9-84d6-4ae0-b931-9c9d27bb59a0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:26.824750 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5dfb5fa9-84d6-4ae0-b931-9c9d27bb59a0 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.385961 Jan 19 13:13:26.825296 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 580/1163] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:26 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:13:27.843032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-363314f0-6937-40f4-bb84-509d9ad57106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:27.843935 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-363314f0-6937-40f4-bb84-509d9ad57106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:27.851264 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-363314f0-6937-40f4-bb84-509d9ad57106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:27.852237 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-363314f0-6937-40f4-bb84-509d9ad57106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:27.853245 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-363314f0-6937-40f4-bb84-509d9ad57106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:27.853918 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-363314f0-6937-40f4-bb84-509d9ad57106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:28.002822 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-363314f0-6937-40f4-bb84-509d9ad57106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:28.031264 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-363314f0-6937-40f4-bb84-509d9ad57106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:28.033403 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-363314f0-6937-40f4-bb84-509d9ad57106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:28.036058 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-363314f0-6937-40f4-bb84-509d9ad57106 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1730 microversion: 2.20 time: 0.197027 Jan 19 13:13:28.047869 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 584/1164] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:27 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:13:29.054891 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b46e2ba1-0e3a-439d-82fb-4732b9b2ca81 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:29.055549 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b46e2ba1-0e3a-439d-82fb-4732b9b2ca81 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:29.061952 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b46e2ba1-0e3a-439d-82fb-4732b9b2ca81 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:29.062476 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b46e2ba1-0e3a-439d-82fb-4732b9b2ca81 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:29.063323 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b46e2ba1-0e3a-439d-82fb-4732b9b2ca81 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:29.063845 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b46e2ba1-0e3a-439d-82fb-4732b9b2ca81 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:29.247569 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b46e2ba1-0e3a-439d-82fb-4732b9b2ca81 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:29.255416 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b46e2ba1-0e3a-439d-82fb-4732b9b2ca81 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:29.257759 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b46e2ba1-0e3a-439d-82fb-4732b9b2ca81 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:29.258940 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b46e2ba1-0e3a-439d-82fb-4732b9b2ca81 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1717 microversion: 2.20 time: 0.207922 Jan 19 13:13:29.259497 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 581/1165] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:13:29 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1717 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:13:29.473550 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b72ca1ce-e7f3-4898-a04c-35b7201a31a9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:29.474480 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b72ca1ce-e7f3-4898-a04c-35b7201a31a9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:29.481428 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b72ca1ce-e7f3-4898-a04c-35b7201a31a9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:29.481884 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b72ca1ce-e7f3-4898-a04c-35b7201a31a9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:29.482665 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b72ca1ce-e7f3-4898-a04c-35b7201a31a9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:29.483107 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b72ca1ce-e7f3-4898-a04c-35b7201a31a9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:29.511766 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b72ca1ce-e7f3-4898-a04c-35b7201a31a9 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041933 Jan 19 13:13:29.512363 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 585/1166] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:13:29 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:13:29.522012 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7067355d-8969-43ec-81ae-b113f1123a1d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:29.523098 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7067355d-8969-43ec-81ae-b113f1123a1d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:29.528847 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7067355d-8969-43ec-81ae-b113f1123a1d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:29.529292 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7067355d-8969-43ec-81ae-b113f1123a1d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:29.530061 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7067355d-8969-43ec-81ae-b113f1123a1d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:29.530486 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7067355d-8969-43ec-81ae-b113f1123a1d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:29.559625 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7067355d-8969-43ec-81ae-b113f1123a1d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments/749323b3-952f-4693-bd82-04f6949c86c7" status: 200 len: 194 microversion: 2.1 time: 0.041317 Jan 19 13:13:29.560233 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 582/1167] 10.222.0.48 () {58 vars in 1412 bytes} [Wed Jan 19 13:13:29 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments/749323b3-952f-4693-bd82-04f6949c86c7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:13:30.880649 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3790a673-2268-43fd-b5c3-2d82aee74970 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc251803-80be-4b10-9a07-534847990773"}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:30.881751 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3790a673-2268-43fd-b5c3-2d82aee74970 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:30.888597 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3790a673-2268-43fd-b5c3-2d82aee74970 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:30.889057 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3790a673-2268-43fd-b5c3-2d82aee74970 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:30.889854 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3790a673-2268-43fd-b5c3-2d82aee74970 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:30.890302 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3790a673-2268-43fd-b5c3-2d82aee74970 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:31.142977 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3790a673-2268-43fd-b5c3-2d82aee74970 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265982 Jan 19 13:13:31.143677 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 586/1168] 10.222.0.48 () {60 vars in 1322 bytes} [Wed Jan 19 13:13:30 2022] POST /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:13:38.642127 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3763fff6-5dd7-46b1-9ef0-20aa0c5408b6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:38.643132 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3763fff6-5dd7-46b1-9ef0-20aa0c5408b6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:38.649849 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3763fff6-5dd7-46b1-9ef0-20aa0c5408b6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:38.650306 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3763fff6-5dd7-46b1-9ef0-20aa0c5408b6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:38.651084 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3763fff6-5dd7-46b1-9ef0-20aa0c5408b6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:38.651526 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3763fff6-5dd7-46b1-9ef0-20aa0c5408b6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:38.681140 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3763fff6-5dd7-46b1-9ef0-20aa0c5408b6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042761 Jan 19 13:13:38.681684 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 583/1169] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:13:38 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:13:38.937652 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-42effc35-2bb7-4dd5-ae3f-fca1cef7b080 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:38.938268 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-42effc35-2bb7-4dd5-ae3f-fca1cef7b080 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:38.944438 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-42effc35-2bb7-4dd5-ae3f-fca1cef7b080 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:38.944886 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-42effc35-2bb7-4dd5-ae3f-fca1cef7b080 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:38.945656 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-42effc35-2bb7-4dd5-ae3f-fca1cef7b080 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:38.946091 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-42effc35-2bb7-4dd5-ae3f-fca1cef7b080 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:38.973569 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-42effc35-2bb7-4dd5-ae3f-fca1cef7b080 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments/749323b3-952f-4693-bd82-04f6949c86c7" status: 200 len: 194 microversion: 2.1 time: 0.040599 Jan 19 13:13:38.974144 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 587/1170] 10.222.0.48 () {58 vars in 1412 bytes} [Wed Jan 19 13:13:38 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments/749323b3-952f-4693-bd82-04f6949c86c7 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:13:38.983882 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-cd79b075-3832-4486-958e-058e50c93452 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:38.984400 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-cd79b075-3832-4486-958e-058e50c93452 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:38.990185 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cd79b075-3832-4486-958e-058e50c93452 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:38.991301 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cd79b075-3832-4486-958e-058e50c93452 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:38.992210 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cd79b075-3832-4486-958e-058e50c93452 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:38.992659 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cd79b075-3832-4486-958e-058e50c93452 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:39.067527 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.objects.instance [None req-cd79b075-3832-4486-958e-058e50c93452 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lazy-loading 'services' on Instance uuid 825e3e43-b49a-46d8-bc83-b84e174ae95f {{(pid=116360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:13:39.134286 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-cd79b075-3832-4486-958e-058e50c93452 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "DELETE /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments/749323b3-952f-4693-bd82-04f6949c86c7" status: 202 len: 0 microversion: 2.1 time: 0.154011 Jan 19 13:13:39.134862 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 584/1171] 10.222.0.48 () {58 vars in 1415 bytes} [Wed Jan 19 13:13:38 2022] DELETE /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments/749323b3-952f-4693-bd82-04f6949c86c7 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:13:40.246037 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-076c5295-0493-46ad-b2e7-855cca76af8d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:40.246575 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-076c5295-0493-46ad-b2e7-855cca76af8d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:40.253027 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-076c5295-0493-46ad-b2e7-855cca76af8d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:40.253515 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-076c5295-0493-46ad-b2e7-855cca76af8d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:40.254315 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-076c5295-0493-46ad-b2e7-855cca76af8d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:40.254868 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-076c5295-0493-46ad-b2e7-855cca76af8d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:40.286472 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-076c5295-0493-46ad-b2e7-855cca76af8d tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments/bc251803-80be-4b10-9a07-534847990773" status: 200 len: 194 microversion: 2.1 time: 0.045921 Jan 19 13:13:40.287064 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 588/1172] 10.222.0.48 () {58 vars in 1412 bytes} [Wed Jan 19 13:13:40 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments/bc251803-80be-4b10-9a07-534847990773 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:13:40.298357 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b78a3a25-4b25-4d15-9a7b-a33cd9c527b4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:40.298938 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b78a3a25-4b25-4d15-9a7b-a33cd9c527b4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:40.305923 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b78a3a25-4b25-4d15-9a7b-a33cd9c527b4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:40.306534 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b78a3a25-4b25-4d15-9a7b-a33cd9c527b4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:40.307154 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b78a3a25-4b25-4d15-9a7b-a33cd9c527b4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:40.307592 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b78a3a25-4b25-4d15-9a7b-a33cd9c527b4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:40.385242 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.objects.instance [None req-b78a3a25-4b25-4d15-9a7b-a33cd9c527b4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lazy-loading 'services' on Instance uuid 825e3e43-b49a-46d8-bc83-b84e174ae95f {{(pid=116360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:13:40.459042 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b78a3a25-4b25-4d15-9a7b-a33cd9c527b4 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "DELETE /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments/bc251803-80be-4b10-9a07-534847990773" status: 202 len: 0 microversion: 2.1 time: 0.165077 Jan 19 13:13:40.459641 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 585/1173] 10.222.0.48 () {58 vars in 1415 bytes} [Wed Jan 19 13:13:40 2022] DELETE /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments/bc251803-80be-4b10-9a07-534847990773 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:13:41.611257 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-bc95d4c7-4307-46fa-acd2-fdeeda622dc6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:41.612266 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-bc95d4c7-4307-46fa-acd2-fdeeda622dc6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:41.619246 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bc95d4c7-4307-46fa-acd2-fdeeda622dc6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:41.619692 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bc95d4c7-4307-46fa-acd2-fdeeda622dc6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:41.620512 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bc95d4c7-4307-46fa-acd2-fdeeda622dc6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:41.620952 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-bc95d4c7-4307-46fa-acd2-fdeeda622dc6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:41.650794 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-bc95d4c7-4307-46fa-acd2-fdeeda622dc6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043363 Jan 19 13:13:41.651341 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 589/1174] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:13:41 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:13:41.750443 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-daa9f7b5-5226-4f30-bed6-52517fd7befa tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:41.751494 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-daa9f7b5-5226-4f30-bed6-52517fd7befa tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:41.757940 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-daa9f7b5-5226-4f30-bed6-52517fd7befa tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:41.758395 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-daa9f7b5-5226-4f30-bed6-52517fd7befa tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:41.759169 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-daa9f7b5-5226-4f30-bed6-52517fd7befa tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:41.759610 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-daa9f7b5-5226-4f30-bed6-52517fd7befa tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:41.787301 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-daa9f7b5-5226-4f30-bed6-52517fd7befa tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041346 Jan 19 13:13:41.788400 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 586/1175] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:13:41 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:13:41.841098 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e00091af-2281-4a8d-960e-d86e4a9688ea tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:41.841594 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e00091af-2281-4a8d-960e-d86e4a9688ea tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:41.847246 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e00091af-2281-4a8d-960e-d86e4a9688ea tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:41.847697 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e00091af-2281-4a8d-960e-d86e4a9688ea tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:41.848497 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e00091af-2281-4a8d-960e-d86e4a9688ea tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:41.848933 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e00091af-2281-4a8d-960e-d86e4a9688ea tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:41.873989 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e00091af-2281-4a8d-960e-d86e4a9688ea tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Going to try to terminate instance {{(pid=116361) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:13:41.946569 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e00091af-2281-4a8d-960e-d86e4a9688ea tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "DELETE /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 204 len: 0 microversion: 2.1 time: 0.108753 Jan 19 13:13:41.954832 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 590/1176] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:13:41 2022] DELETE /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:13:41.964994 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3d470dc5-fca7-4a98-8d81-56eb4c2f23b6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:41.965610 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3d470dc5-fca7-4a98-8d81-56eb4c2f23b6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:41.972200 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3d470dc5-fca7-4a98-8d81-56eb4c2f23b6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:41.972661 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3d470dc5-fca7-4a98-8d81-56eb4c2f23b6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:41.973526 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3d470dc5-fca7-4a98-8d81-56eb4c2f23b6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:41.973972 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3d470dc5-fca7-4a98-8d81-56eb4c2f23b6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:42.109508 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3d470dc5-fca7-4a98-8d81-56eb4c2f23b6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:42.117865 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3d470dc5-fca7-4a98-8d81-56eb4c2f23b6 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 200 len: 1675 microversion: 2.1 time: 0.156692 Jan 19 13:13:42.118433 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 587/1177] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:13:41 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:13:43.136252 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b370b73d-21fb-4e48-b9c9-0e5823e95bdf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:43.136875 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b370b73d-21fb-4e48-b9c9-0e5823e95bdf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:43.143155 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b370b73d-21fb-4e48-b9c9-0e5823e95bdf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:43.143608 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b370b73d-21fb-4e48-b9c9-0e5823e95bdf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:43.144428 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b370b73d-21fb-4e48-b9c9-0e5823e95bdf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:43.144871 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b370b73d-21fb-4e48-b9c9-0e5823e95bdf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:43.271577 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b370b73d-21fb-4e48-b9c9-0e5823e95bdf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:43.279275 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b370b73d-21fb-4e48-b9c9-0e5823e95bdf tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 200 len: 1675 microversion: 2.1 time: 0.148164 Jan 19 13:13:43.279848 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 591/1178] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:13:43 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:13:44.297007 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-441c0a22-cd1a-43d3-8d30-2dedc9f91464 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:44.297729 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-441c0a22-cd1a-43d3-8d30-2dedc9f91464 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:44.304708 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-441c0a22-cd1a-43d3-8d30-2dedc9f91464 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:44.305161 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-441c0a22-cd1a-43d3-8d30-2dedc9f91464 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:44.305940 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-441c0a22-cd1a-43d3-8d30-2dedc9f91464 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:44.306376 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-441c0a22-cd1a-43d3-8d30-2dedc9f91464 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:44.526810 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-441c0a22-cd1a-43d3-8d30-2dedc9f91464 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4c420e958c47fc9a36e1602e5a2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0e1420e5d740a89a0d8b78be696f12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:44.534257 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-441c0a22-cd1a-43d3-8d30-2dedc9f91464 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 200 len: 1675 microversion: 2.1 time: 0.240957 Jan 19 13:13:44.534819 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 588/1179] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:13:44 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 1675 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:13:44.741096 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-51dec4f3-5be5-4371-8d23-783da3c9aed6 req-f26b2cc0-eac3-46fc-970a-181ee0e86069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825e3e43-b49a-46d8-bc83-b84e174ae95f", "name": "network-vif-deleted", "tag": "1d479fcb-0ca4-49aa-aa72-b943622b48f5"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:44.742849 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:13:44.742849 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:13:44.750063 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-51dec4f3-5be5-4371-8d23-783da3c9aed6 req-f26b2cc0-eac3-46fc-970a-181ee0e86069 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:44.750515 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-51dec4f3-5be5-4371-8d23-783da3c9aed6 req-f26b2cc0-eac3-46fc-970a-181ee0e86069 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:44.763473 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-51dec4f3-5be5-4371-8d23-783da3c9aed6 req-f26b2cc0-eac3-46fc-970a-181ee0e86069 service nova] Creating event network-vif-deleted:1d479fcb-0ca4-49aa-aa72-b943622b48f5 for instance 825e3e43-b49a-46d8-bc83-b84e174ae95f on hv-cinder-82301 Jan 19 13:13:44.768709 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-51dec4f3-5be5-4371-8d23-783da3c9aed6 req-f26b2cc0-eac3-46fc-970a-181ee0e86069 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032091 Jan 19 13:13:44.769693 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 592/1180] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:13:45.551390 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a9b3e2fe-5e8e-4a07-a4e1-a8c8c1428f2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:45.552172 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a9b3e2fe-5e8e-4a07-a4e1-a8c8c1428f2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:45.559175 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9b3e2fe-5e8e-4a07-a4e1-a8c8c1428f2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:45.559630 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9b3e2fe-5e8e-4a07-a4e1-a8c8c1428f2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:45.560450 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9b3e2fe-5e8e-4a07-a4e1-a8c8c1428f2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:45.561110 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a9b3e2fe-5e8e-4a07-a4e1-a8c8c1428f2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:45.575787 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-a9b3e2fe-5e8e-4a07-a4e1-a8c8c1428f2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] HTTP exception thrown: Instance 825e3e43-b49a-46d8-bc83-b84e174ae95f could not be found. Jan 19 13:13:45.576514 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a9b3e2fe-5e8e-4a07-a4e1-a8c8c1428f2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Returning 404 to user: Instance 825e3e43-b49a-46d8-bc83-b84e174ae95f could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:13:45.577233 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a9b3e2fe-5e8e-4a07-a4e1-a8c8c1428f2f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 404 len: 111 microversion: 2.1 time: 0.029560 Jan 19 13:13:45.577778 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 589/1181] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:13:45 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:13:45.586790 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7b94f5b8-a6a8-4884-8923-e221e3c09aef tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '.version_select at 0x7f07d7c95670>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:45.605492 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7b94f5b8-a6a8-4884-8923-e221e3c09aef tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1622795259" status: 202 len: 0 microversion: 2.1 time: 0.022914 Jan 19 13:13:45.606069 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 593/1182] 10.222.0.48 () {58 vars in 1220 bytes} [Wed Jan 19 13:13:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1622795259 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:13:48.497186 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5440baf2-fe8b-4ee9-a499-b0453e124fb5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:48.497714 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5440baf2-fe8b-4ee9-a499-b0453e124fb5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:48.503973 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5440baf2-fe8b-4ee9-a499-b0453e124fb5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:48.504459 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5440baf2-fe8b-4ee9-a499-b0453e124fb5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:48.505488 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5440baf2-fe8b-4ee9-a499-b0453e124fb5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:48.506441 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5440baf2-fe8b-4ee9-a499-b0453e124fb5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:48.520479 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-5440baf2-fe8b-4ee9-a499-b0453e124fb5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] HTTP exception thrown: Instance 825e3e43-b49a-46d8-bc83-b84e174ae95f could not be found. Jan 19 13:13:48.521153 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5440baf2-fe8b-4ee9-a499-b0453e124fb5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Returning 404 to user: Instance 825e3e43-b49a-46d8-bc83-b84e174ae95f could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:13:48.523018 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5440baf2-fe8b-4ee9-a499-b0453e124fb5 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "DELETE /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 404 len: 111 microversion: 2.1 time: 0.029557 Jan 19 13:13:48.523537 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 590/1183] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:13:48 2022] DELETE /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:13:48.532045 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-11aa9c47-e061-4672-80ca-d4ec1061527f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:48.532811 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-11aa9c47-e061-4672-80ca-d4ec1061527f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: 825e3e43-b49a-46d8-bc83-b84e174ae95f] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:48.538887 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-11aa9c47-e061-4672-80ca-d4ec1061527f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:48.539339 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-11aa9c47-e061-4672-80ca-d4ec1061527f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:48.540155 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-11aa9c47-e061-4672-80ca-d4ec1061527f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:48.540601 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-11aa9c47-e061-4672-80ca-d4ec1061527f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:48.553635 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-11aa9c47-e061-4672-80ca-d4ec1061527f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] HTTP exception thrown: Instance 825e3e43-b49a-46d8-bc83-b84e174ae95f could not be found. Jan 19 13:13:48.554220 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-11aa9c47-e061-4672-80ca-d4ec1061527f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Returning 404 to user: Instance 825e3e43-b49a-46d8-bc83-b84e174ae95f could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:13:48.555041 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-11aa9c47-e061-4672-80ca-d4ec1061527f tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f" status: 404 len: 111 microversion: 2.1 time: 0.027359 Jan 19 13:13:48.555572 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 594/1184] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:13:48 2022] GET /compute/v2.1/servers/825e3e43-b49a-46d8-bc83-b84e174ae95f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:13:49.680516 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-452128c7-5b1f-4f77-ae2a-76a15ab16b25 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:49.681021 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-452128c7-5b1f-4f77-ae2a-76a15ab16b25 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:49.687382 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-452128c7-5b1f-4f77-ae2a-76a15ab16b25 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:49.687835 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-452128c7-5b1f-4f77-ae2a-76a15ab16b25 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:49.688644 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-452128c7-5b1f-4f77-ae2a-76a15ab16b25 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:49.689157 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-452128c7-5b1f-4f77-ae2a-76a15ab16b25 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:49.703137 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-452128c7-5b1f-4f77-ae2a-76a15ab16b25 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] HTTP exception thrown: Instance e4c0570c-1d8d-41ff-9ec2-9325d1a121ca could not be found. Jan 19 13:13:49.703754 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-452128c7-5b1f-4f77-ae2a-76a15ab16b25 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Returning 404 to user: Instance e4c0570c-1d8d-41ff-9ec2-9325d1a121ca could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:13:49.704616 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-452128c7-5b1f-4f77-ae2a-76a15ab16b25 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 404 len: 111 microversion: 2.1 time: 0.028509 Jan 19 13:13:49.705149 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 591/1185] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:13:49 2022] DELETE /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:13:49.713267 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-05621ac7-30c2-4704-8a25-cf48936750f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:49.713879 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-05621ac7-30c2-4704-8a25-cf48936750f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] [instance: e4c0570c-1d8d-41ff-9ec2-9325d1a121ca] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:49.720206 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05621ac7-30c2-4704-8a25-cf48936750f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:49.720667 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05621ac7-30c2-4704-8a25-cf48936750f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:49.721456 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05621ac7-30c2-4704-8a25-cf48936750f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:49.721896 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05621ac7-30c2-4704-8a25-cf48936750f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:49.735234 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-05621ac7-30c2-4704-8a25-cf48936750f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] HTTP exception thrown: Instance e4c0570c-1d8d-41ff-9ec2-9325d1a121ca could not be found. Jan 19 13:13:49.735818 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-05621ac7-30c2-4704-8a25-cf48936750f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] Returning 404 to user: Instance e4c0570c-1d8d-41ff-9ec2-9325d1a121ca could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:13:49.736661 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-05621ac7-30c2-4704-8a25-cf48936750f8 tempest-AttachVolumeTestJSON-2075379790 tempest-AttachVolumeTestJSON-2075379790-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca" status: 404 len: 111 microversion: 2.1 time: 0.027424 Jan 19 13:13:49.737184 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 595/1186] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:13:49 2022] GET /compute/v2.1/servers/e4c0570c-1d8d-41ff-9ec2-9325d1a121ca => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:13:55.150642 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-888294663", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452", "networks": [{"uuid": "35b16c67-43df-4608-874b-8f57b3714987"}]}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:55.205691 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.network.neutron [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] validate_networks() for [('35b16c67-43df-4608-874b-8f57b3714987', None, None, None, None, None)] {{(pid=116360) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:13:55.538295 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Flavor limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:13:55.538713 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Image limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:13:55.539211 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Flavor pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:13:55.539615 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Image pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:13:55.540057 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:13:55.548522 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:55.548966 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:55.549804 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:55.550239 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:55.566757 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Getting quotas for project 572a039c553a406a96e802aa59566f87. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:13:55.570715 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Getting quotas for user a910cea139a54d91b857994060c3ba42 and project 572a039c553a406a96e802aa59566f87. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:13:55.581091 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Going to run 1 instances... {{(pid=116360) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:13:55.583327 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:13:55.625080 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [efe1d542-f9cd-4d6e-8214-9fe5900ba5c3] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 19 13:13:56.633128 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO oslo.messaging._drivers.impl_rabbit [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [efe1d542-f9cd-4d6e-8214-9fe5900ba5c3] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 54134. Jan 19 13:13:56.636954 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6aacc164-3edd-4f05-9e50-4c60943587fa tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.596895 Jan 19 13:13:56.637632 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 592/1187] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:13:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:13:56.647880 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d0046271-39df-4ef1-ac6c-190073facea7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:56.648508 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d0046271-39df-4ef1-ac6c-190073facea7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:56.699315 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d0046271-39df-4ef1-ac6c-190073facea7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:56.705803 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d0046271-39df-4ef1-ac6c-190073facea7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 200 len: 1217 microversion: 2.1 time: 0.062177 Jan 19 13:13:56.706390 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 596/1188] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:13:56 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 1217 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:13:57.722951 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6ee1a489-1bbf-4d0a-b3cf-e7cc517dc4ef tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:57.723563 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6ee1a489-1bbf-4d0a-b3cf-e7cc517dc4ef tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:57.730994 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ee1a489-1bbf-4d0a-b3cf-e7cc517dc4ef tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:57.731452 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ee1a489-1bbf-4d0a-b3cf-e7cc517dc4ef tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:57.732261 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ee1a489-1bbf-4d0a-b3cf-e7cc517dc4ef tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:57.732703 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ee1a489-1bbf-4d0a-b3cf-e7cc517dc4ef tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:57.807810 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6ee1a489-1bbf-4d0a-b3cf-e7cc517dc4ef tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:57.815119 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6ee1a489-1bbf-4d0a-b3cf-e7cc517dc4ef tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 200 len: 1275 microversion: 2.1 time: 0.096358 Jan 19 13:13:57.815877 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 593/1189] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:13:57 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:13:58.831742 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f4f39d2c-021f-430b-abec-05542bba684c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:13:58.832419 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f4f39d2c-021f-430b-abec-05542bba684c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:13:58.841363 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f4f39d2c-021f-430b-abec-05542bba684c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:58.841363 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f4f39d2c-021f-430b-abec-05542bba684c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:58.841363 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f4f39d2c-021f-430b-abec-05542bba684c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:58.841363 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f4f39d2c-021f-430b-abec-05542bba684c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:59.042976 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f4f39d2c-021f-430b-abec-05542bba684c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:13:59.050739 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f4f39d2c-021f-430b-abec-05542bba684c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 200 len: 1317 microversion: 2.1 time: 0.222980 Jan 19 13:13:59.051411 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 597/1190] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:13:58 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:13:59.116644 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-0bb5f315-8868-4c33-be75-ab3f63e56dfe req-0b3f6220-b39c-4e70-bd40-68911d58d749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b70d986e-67d9-4c1a-b4e1-0d05a727b5b6", "tag": "9205ccaa-4015-4f7f-9495-f8d8bf8b4502"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:13:59.118292 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:13:59.118292 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:13:59.129419 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-0bb5f315-8868-4c33-be75-ab3f63e56dfe req-0b3f6220-b39c-4e70-bd40-68911d58d749 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:13:59.130741 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-0bb5f315-8868-4c33-be75-ab3f63e56dfe req-0b3f6220-b39c-4e70-bd40-68911d58d749 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:13:59.144375 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-0bb5f315-8868-4c33-be75-ab3f63e56dfe req-0b3f6220-b39c-4e70-bd40-68911d58d749 service nova] Creating event network-changed:9205ccaa-4015-4f7f-9495-f8d8bf8b4502 for instance b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 on hv-cinder-82301 Jan 19 13:13:59.149783 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-0bb5f315-8868-4c33-be75-ab3f63e56dfe req-0b3f6220-b39c-4e70-bd40-68911d58d749 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037088 Jan 19 13:13:59.150390 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 594/1191] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:14:00.068660 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d6227f1c-1a67-4275-acac-b7e407f26cd2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:00.069264 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d6227f1c-1a67-4275-acac-b7e407f26cd2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:00.076212 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d6227f1c-1a67-4275-acac-b7e407f26cd2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:00.076657 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d6227f1c-1a67-4275-acac-b7e407f26cd2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:00.077426 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d6227f1c-1a67-4275-acac-b7e407f26cd2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:00.077859 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d6227f1c-1a67-4275-acac-b7e407f26cd2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:00.205225 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d6227f1c-1a67-4275-acac-b7e407f26cd2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:00.212498 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d6227f1c-1a67-4275-acac-b7e407f26cd2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 200 len: 1317 microversion: 2.1 time: 0.148010 Jan 19 13:14:00.213061 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 598/1192] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:00 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:01.229671 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2ac3f57e-0026-458d-907d-638da1efcfc5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:01.230323 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2ac3f57e-0026-458d-907d-638da1efcfc5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:01.236868 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ac3f57e-0026-458d-907d-638da1efcfc5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:01.237324 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ac3f57e-0026-458d-907d-638da1efcfc5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:01.238104 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ac3f57e-0026-458d-907d-638da1efcfc5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:01.238546 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2ac3f57e-0026-458d-907d-638da1efcfc5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:01.367611 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2ac3f57e-0026-458d-907d-638da1efcfc5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:01.374856 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2ac3f57e-0026-458d-907d-638da1efcfc5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 200 len: 1317 microversion: 2.1 time: 0.149431 Jan 19 13:14:01.375414 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 595/1193] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:01 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:14:02.392038 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3bdb32fc-2d0d-41ef-9b4f-1bc28189235d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:02.392648 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3bdb32fc-2d0d-41ef-9b4f-1bc28189235d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:02.399702 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3bdb32fc-2d0d-41ef-9b4f-1bc28189235d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:02.400190 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3bdb32fc-2d0d-41ef-9b4f-1bc28189235d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:02.400967 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3bdb32fc-2d0d-41ef-9b4f-1bc28189235d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:02.401495 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3bdb32fc-2d0d-41ef-9b4f-1bc28189235d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:02.531673 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3bdb32fc-2d0d-41ef-9b4f-1bc28189235d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:02.539486 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3bdb32fc-2d0d-41ef-9b4f-1bc28189235d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 200 len: 1317 microversion: 2.1 time: 0.151317 Jan 19 13:14:02.540057 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 599/1194] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:02 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:03.556453 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-937d9053-7d79-4b26-9491-e1d791865d66 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:03.557067 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-937d9053-7d79-4b26-9491-e1d791865d66 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:03.563660 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-937d9053-7d79-4b26-9491-e1d791865d66 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:03.564151 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-937d9053-7d79-4b26-9491-e1d791865d66 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:03.564934 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-937d9053-7d79-4b26-9491-e1d791865d66 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:03.565378 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-937d9053-7d79-4b26-9491-e1d791865d66 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:03.721857 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-937d9053-7d79-4b26-9491-e1d791865d66 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:03.729692 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-937d9053-7d79-4b26-9491-e1d791865d66 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 200 len: 1317 microversion: 2.1 time: 0.177566 Jan 19 13:14:03.730274 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 596/1195] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:03 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:04.746093 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2aeb7544-052f-4c16-a976-e0f6a63b70b1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:04.746693 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2aeb7544-052f-4c16-a976-e0f6a63b70b1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:04.752975 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2aeb7544-052f-4c16-a976-e0f6a63b70b1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:04.753422 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2aeb7544-052f-4c16-a976-e0f6a63b70b1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:04.754195 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2aeb7544-052f-4c16-a976-e0f6a63b70b1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:04.754630 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2aeb7544-052f-4c16-a976-e0f6a63b70b1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:04.885228 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2aeb7544-052f-4c16-a976-e0f6a63b70b1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:04.892591 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2aeb7544-052f-4c16-a976-e0f6a63b70b1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 200 len: 1317 microversion: 2.1 time: 0.150247 Jan 19 13:14:04.893189 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 600/1196] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:04 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:05.692292 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-d689f273-a6fe-4a4e-adfc-06aac7d30081 req-2bb4224b-744f-441b-9ca3-5f23735b9059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70d986e-67d9-4c1a-b4e1-0d05a727b5b6", "name": "network-vif-plugged", "status": "completed", "tag": "9205ccaa-4015-4f7f-9495-f8d8bf8b4502"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:14:05.700710 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:14:05.700710 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:14:05.711114 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-d689f273-a6fe-4a4e-adfc-06aac7d30081 req-2bb4224b-744f-441b-9ca3-5f23735b9059 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:05.711553 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-d689f273-a6fe-4a4e-adfc-06aac7d30081 req-2bb4224b-744f-441b-9ca3-5f23735b9059 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:05.722206 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-d689f273-a6fe-4a4e-adfc-06aac7d30081 req-2bb4224b-744f-441b-9ca3-5f23735b9059 service nova] Creating event network-vif-plugged:9205ccaa-4015-4f7f-9495-f8d8bf8b4502 for instance b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 on hv-cinder-82301 Jan 19 13:14:05.727619 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-d689f273-a6fe-4a4e-adfc-06aac7d30081 req-2bb4224b-744f-441b-9ca3-5f23735b9059 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038957 Jan 19 13:14:05.728652 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 597/1197] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:14:05.908256 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-01b3987e-7e36-4729-bc21-468d1f8de22c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:05.908870 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-01b3987e-7e36-4729-bc21-468d1f8de22c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:05.916509 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-01b3987e-7e36-4729-bc21-468d1f8de22c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:05.916937 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-01b3987e-7e36-4729-bc21-468d1f8de22c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:05.917736 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-01b3987e-7e36-4729-bc21-468d1f8de22c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:05.918173 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-01b3987e-7e36-4729-bc21-468d1f8de22c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:06.048296 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-01b3987e-7e36-4729-bc21-468d1f8de22c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:06.055485 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-01b3987e-7e36-4729-bc21-468d1f8de22c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 200 len: 1317 microversion: 2.1 time: 0.150898 Jan 19 13:14:06.056075 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 601/1198] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:05 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:07.072503 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-bbcec6d6-1d77-454d-86ee-3acd8bcab70d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:07.073196 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-bbcec6d6-1d77-454d-86ee-3acd8bcab70d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:07.079575 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bbcec6d6-1d77-454d-86ee-3acd8bcab70d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:07.080070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bbcec6d6-1d77-454d-86ee-3acd8bcab70d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:07.080829 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bbcec6d6-1d77-454d-86ee-3acd8bcab70d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:07.081263 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bbcec6d6-1d77-454d-86ee-3acd8bcab70d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:07.215620 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bbcec6d6-1d77-454d-86ee-3acd8bcab70d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:07.223071 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-bbcec6d6-1d77-454d-86ee-3acd8bcab70d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 200 len: 1317 microversion: 2.1 time: 0.155375 Jan 19 13:14:07.223632 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 598/1199] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:07 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:08.240967 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f7a8f7b9-18e3-42ca-a5cf-4cdf536b33bf tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:08.241519 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f7a8f7b9-18e3-42ca-a5cf-4cdf536b33bf tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:08.247483 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f7a8f7b9-18e3-42ca-a5cf-4cdf536b33bf tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:08.247919 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f7a8f7b9-18e3-42ca-a5cf-4cdf536b33bf tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:08.248711 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f7a8f7b9-18e3-42ca-a5cf-4cdf536b33bf tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:08.249141 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f7a8f7b9-18e3-42ca-a5cf-4cdf536b33bf tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:08.376512 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f7a8f7b9-18e3-42ca-a5cf-4cdf536b33bf tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:08.384806 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f7a8f7b9-18e3-42ca-a5cf-4cdf536b33bf tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 200 len: 1507 microversion: 2.1 time: 0.148259 Jan 19 13:14:08.385378 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 602/1200] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:08 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:09.717584 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-98dc3bd1-d74c-4b6a-b57d-21babaed3d9d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7c6b7a6-2520-4a37-8b15-decbfca8c2b2"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:14:09.718646 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-98dc3bd1-d74c-4b6a-b57d-21babaed3d9d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:09.725166 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-98dc3bd1-d74c-4b6a-b57d-21babaed3d9d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:09.725616 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-98dc3bd1-d74c-4b6a-b57d-21babaed3d9d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:09.726391 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-98dc3bd1-d74c-4b6a-b57d-21babaed3d9d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:09.726832 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-98dc3bd1-d74c-4b6a-b57d-21babaed3d9d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:09.954051 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-98dc3bd1-d74c-4b6a-b57d-21babaed3d9d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "POST /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240107 Jan 19 13:14:09.955250 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 599/1201] 10.222.0.48 () {60 vars in 1322 bytes} [Wed Jan 19 13:14:09 2022] POST /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:14:17.447585 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-871834535", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452", "networks": [{"uuid": "35b16c67-43df-4608-874b-8f57b3714987"}]}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:14:17.498676 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.network.neutron [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] validate_networks() for [('35b16c67-43df-4608-874b-8f57b3714987', None, None, None, None, None)] {{(pid=116361) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:14:17.854086 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Flavor limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:14:17.854509 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Image limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:14:17.854981 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Flavor pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:14:17.855420 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Image pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:14:17.855830 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:14:17.865147 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:17.865147 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:17.865955 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:17.866391 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:17.883176 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Getting quotas for project 572a039c553a406a96e802aa59566f87. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:14:17.887061 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Getting quotas for user a910cea139a54d91b857994060c3ba42 and project 572a039c553a406a96e802aa59566f87. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:14:17.898124 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Going to run 1 instances... {{(pid=116361) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:14:17.900457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:14:17.944813 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8401930f-14c5-4152-ab1b-045d4a59b411 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500850 Jan 19 13:14:17.945452 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 603/1202] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:14:17.955772 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-fda10d43-69d5-443e-ba4b-589598fe2146 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:17.956507 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-fda10d43-69d5-443e-ba4b-589598fe2146 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:18.062799 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-fda10d43-69d5-443e-ba4b-589598fe2146 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:18.070003 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-fda10d43-69d5-443e-ba4b-589598fe2146 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b" status: 200 len: 1217 microversion: 2.1 time: 0.118314 Jan 19 13:14:18.070864 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 600/1203] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:17 2022] GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b => generated 1217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:19.087875 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5e92593f-fcd7-4326-bd7a-4bbfd16184df tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:19.088527 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5e92593f-fcd7-4326-bd7a-4bbfd16184df tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:19.097348 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5e92593f-fcd7-4326-bd7a-4bbfd16184df tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:19.097805 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5e92593f-fcd7-4326-bd7a-4bbfd16184df tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:19.098695 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5e92593f-fcd7-4326-bd7a-4bbfd16184df tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:19.099695 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5e92593f-fcd7-4326-bd7a-4bbfd16184df tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:19.234981 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5e92593f-fcd7-4326-bd7a-4bbfd16184df tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:19.243602 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5e92593f-fcd7-4326-bd7a-4bbfd16184df tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b" status: 200 len: 1275 microversion: 2.1 time: 0.160465 Jan 19 13:14:19.244223 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 604/1204] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:19 2022] GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:20.103452 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-62866323-5187-4914-adcb-cee62d49e3cc req-b1928db9-deee-455d-b9e8-f4483ef412d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f888fb9-a7aa-49fe-a65a-d88552b69b0b", "tag": "59c5b9d4-f569-4a17-981a-bf4fe9a03bbb"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:14:20.105058 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:14:20.105058 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:14:20.113009 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-62866323-5187-4914-adcb-cee62d49e3cc req-b1928db9-deee-455d-b9e8-f4483ef412d3 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:20.113446 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-62866323-5187-4914-adcb-cee62d49e3cc req-b1928db9-deee-455d-b9e8-f4483ef412d3 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:20.126430 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-62866323-5187-4914-adcb-cee62d49e3cc req-b1928db9-deee-455d-b9e8-f4483ef412d3 service nova] Creating event network-changed:59c5b9d4-f569-4a17-981a-bf4fe9a03bbb for instance 0f888fb9-a7aa-49fe-a65a-d88552b69b0b on hv-cinder-82301 Jan 19 13:14:20.135019 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-62866323-5187-4914-adcb-cee62d49e3cc req-b1928db9-deee-455d-b9e8-f4483ef412d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035442 Jan 19 13:14:20.135676 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 601/1205] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:14:20.262438 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d275a2d6-e462-4dd9-91d1-dbe4f60c58f6 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:20.263152 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d275a2d6-e462-4dd9-91d1-dbe4f60c58f6 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:20.271880 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d275a2d6-e462-4dd9-91d1-dbe4f60c58f6 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:20.272504 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d275a2d6-e462-4dd9-91d1-dbe4f60c58f6 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:20.273453 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d275a2d6-e462-4dd9-91d1-dbe4f60c58f6 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:20.274213 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d275a2d6-e462-4dd9-91d1-dbe4f60c58f6 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:20.478778 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d275a2d6-e462-4dd9-91d1-dbe4f60c58f6 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:20.486107 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d275a2d6-e462-4dd9-91d1-dbe4f60c58f6 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b" status: 200 len: 1317 microversion: 2.1 time: 0.228340 Jan 19 13:14:20.486675 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 605/1206] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:20 2022] GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:14:21.503182 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-fedcd6a4-e9a3-4422-9802-0ffaa1b12d55 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:21.503879 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-fedcd6a4-e9a3-4422-9802-0ffaa1b12d55 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:21.511617 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fedcd6a4-e9a3-4422-9802-0ffaa1b12d55 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:21.512103 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fedcd6a4-e9a3-4422-9802-0ffaa1b12d55 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:21.512874 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fedcd6a4-e9a3-4422-9802-0ffaa1b12d55 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:21.513361 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fedcd6a4-e9a3-4422-9802-0ffaa1b12d55 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:21.648077 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-fedcd6a4-e9a3-4422-9802-0ffaa1b12d55 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:21.655776 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-fedcd6a4-e9a3-4422-9802-0ffaa1b12d55 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b" status: 200 len: 1317 microversion: 2.1 time: 0.156993 Jan 19 13:14:21.656405 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 602/1207] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:21 2022] GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:22.672101 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-87e897d4-79bd-415d-afc0-025bb941f4b2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:22.672676 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-87e897d4-79bd-415d-afc0-025bb941f4b2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:22.679536 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-87e897d4-79bd-415d-afc0-025bb941f4b2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:22.679999 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-87e897d4-79bd-415d-afc0-025bb941f4b2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:22.680782 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-87e897d4-79bd-415d-afc0-025bb941f4b2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:22.681223 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-87e897d4-79bd-415d-afc0-025bb941f4b2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:22.811956 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-87e897d4-79bd-415d-afc0-025bb941f4b2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:22.819847 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-87e897d4-79bd-415d-afc0-025bb941f4b2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b" status: 200 len: 1317 microversion: 2.1 time: 0.151522 Jan 19 13:14:22.820436 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 606/1208] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:22 2022] GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:23.836395 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7915f4f2-b5f3-4953-a3bf-6930785a074b tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:23.837667 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7915f4f2-b5f3-4953-a3bf-6930785a074b tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:23.843911 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7915f4f2-b5f3-4953-a3bf-6930785a074b tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:23.844386 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7915f4f2-b5f3-4953-a3bf-6930785a074b tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:23.845154 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7915f4f2-b5f3-4953-a3bf-6930785a074b tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:23.845586 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7915f4f2-b5f3-4953-a3bf-6930785a074b tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:23.977108 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7915f4f2-b5f3-4953-a3bf-6930785a074b tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:23.985054 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7915f4f2-b5f3-4953-a3bf-6930785a074b tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b" status: 200 len: 1317 microversion: 2.1 time: 0.152740 Jan 19 13:14:23.985845 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 603/1209] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:23 2022] GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:24.773755 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ce3cd260-3ff0-430d-a5e3-c9826c5f7de2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:24.774717 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ce3cd260-3ff0-430d-a5e3-c9826c5f7de2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:24.781008 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ce3cd260-3ff0-430d-a5e3-c9826c5f7de2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:24.781457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ce3cd260-3ff0-430d-a5e3-c9826c5f7de2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:24.782235 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ce3cd260-3ff0-430d-a5e3-c9826c5f7de2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:24.782676 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ce3cd260-3ff0-430d-a5e3-c9826c5f7de2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:24.811228 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ce3cd260-3ff0-430d-a5e3-c9826c5f7de2 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041299 Jan 19 13:14:24.811770 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 607/1210] 10.222.0.48 () {60 vars in 1342 bytes} [Wed Jan 19 13:14:24 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:24.866357 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-898ee505-6e76-4fc5-bb8e-6bbddbde35d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:24.866857 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-898ee505-6e76-4fc5-bb8e-6bbddbde35d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:24.873238 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-898ee505-6e76-4fc5-bb8e-6bbddbde35d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:24.873767 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-898ee505-6e76-4fc5-bb8e-6bbddbde35d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:24.874564 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-898ee505-6e76-4fc5-bb8e-6bbddbde35d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:24.875006 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-898ee505-6e76-4fc5-bb8e-6bbddbde35d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:24.899347 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-898ee505-6e76-4fc5-bb8e-6bbddbde35d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Going to try to terminate instance {{(pid=116360) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:14:24.970947 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-898ee505-6e76-4fc5-bb8e-6bbddbde35d7 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "DELETE /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 204 len: 0 microversion: 2.20 time: 0.108518 Jan 19 13:14:24.971466 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 604/1211] 10.222.0.48 () {60 vars in 1279 bytes} [Wed Jan 19 13:14:24 2022] DELETE /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 19 13:14:24.980213 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6b8465cd-08f2-401f-9717-112931f402e8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:24.980819 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6b8465cd-08f2-401f-9717-112931f402e8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:24.986585 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6b8465cd-08f2-401f-9717-112931f402e8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:24.987039 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6b8465cd-08f2-401f-9717-112931f402e8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:24.987810 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6b8465cd-08f2-401f-9717-112931f402e8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:24.988283 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6b8465cd-08f2-401f-9717-112931f402e8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:25.002579 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6970aceb-9819-486a-9b59-1926d6972154 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:25.003283 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6970aceb-9819-486a-9b59-1926d6972154 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:25.010191 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6970aceb-9819-486a-9b59-1926d6972154 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:25.010646 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6970aceb-9819-486a-9b59-1926d6972154 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:25.011436 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6970aceb-9819-486a-9b59-1926d6972154 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:25.011884 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6970aceb-9819-486a-9b59-1926d6972154 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:25.183239 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6b8465cd-08f2-401f-9717-112931f402e8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:25.187346 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6970aceb-9819-486a-9b59-1926d6972154 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:25.191399 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6b8465cd-08f2-401f-9717-112931f402e8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:25.193092 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-6b8465cd-08f2-401f-9717-112931f402e8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:25.194509 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6b8465cd-08f2-401f-9717-112931f402e8 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.217794 Jan 19 13:14:25.195185 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 608/1212] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:14:24 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:14:25.197766 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6970aceb-9819-486a-9b59-1926d6972154 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b" status: 200 len: 1317 microversion: 2.1 time: 0.199230 Jan 19 13:14:25.198336 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 605/1213] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:24 2022] GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:14:25.863213 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-e3c2d2eb-af95-4c50-ba15-153177074dc5 req-1f516d10-24a2-496e-9b9c-d0cba5d480eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f888fb9-a7aa-49fe-a65a-d88552b69b0b", "name": "network-vif-plugged", "status": "completed", "tag": "59c5b9d4-f569-4a17-981a-bf4fe9a03bbb"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:14:25.866422 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:14:25.866422 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:14:25.873686 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-e3c2d2eb-af95-4c50-ba15-153177074dc5 req-1f516d10-24a2-496e-9b9c-d0cba5d480eb service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:25.874261 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-e3c2d2eb-af95-4c50-ba15-153177074dc5 req-1f516d10-24a2-496e-9b9c-d0cba5d480eb service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:25.886439 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-e3c2d2eb-af95-4c50-ba15-153177074dc5 req-1f516d10-24a2-496e-9b9c-d0cba5d480eb service nova] Creating event network-vif-plugged:59c5b9d4-f569-4a17-981a-bf4fe9a03bbb for instance 0f888fb9-a7aa-49fe-a65a-d88552b69b0b on hv-cinder-82301 Jan 19 13:14:25.891276 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-e3c2d2eb-af95-4c50-ba15-153177074dc5 req-1f516d10-24a2-496e-9b9c-d0cba5d480eb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031794 Jan 19 13:14:25.891859 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 609/1214] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:14:26.214190 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-cc25a8b8-9e42-4c2f-a40a-dc4540b58c29 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:26.215211 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-cc25a8b8-9e42-4c2f-a40a-dc4540b58c29 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:26.221416 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cc25a8b8-9e42-4c2f-a40a-dc4540b58c29 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:26.221874 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cc25a8b8-9e42-4c2f-a40a-dc4540b58c29 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:26.222658 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cc25a8b8-9e42-4c2f-a40a-dc4540b58c29 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:26.223101 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cc25a8b8-9e42-4c2f-a40a-dc4540b58c29 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:26.343763 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ab47ab2f-fa5c-41f6-8562-e8206d5a2a7a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:26.344561 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ab47ab2f-fa5c-41f6-8562-e8206d5a2a7a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:26.350590 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab47ab2f-fa5c-41f6-8562-e8206d5a2a7a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:26.351044 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab47ab2f-fa5c-41f6-8562-e8206d5a2a7a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:26.351824 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab47ab2f-fa5c-41f6-8562-e8206d5a2a7a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:26.352289 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab47ab2f-fa5c-41f6-8562-e8206d5a2a7a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:26.364415 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-cc25a8b8-9e42-4c2f-a40a-dc4540b58c29 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:26.370143 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:14:26.371659 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-cc25a8b8-9e42-4c2f-a40a-dc4540b58c29 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b" status: 200 len: 1317 microversion: 2.1 time: 0.161582 Jan 19 13:14:26.372256 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 610/1215] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:26 2022] GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:14:26.372940 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: Wed Jan 19 13:14:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 (ip 10.222.0.48) !!! Jan 19 13:14:26.485098 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ab47ab2f-fa5c-41f6-8562-e8206d5a2a7a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:26.493842 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ab47ab2f-fa5c-41f6-8562-e8206d5a2a7a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:26.495388 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ab47ab2f-fa5c-41f6-8562-e8206d5a2a7a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:26.496605 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ab47ab2f-fa5c-41f6-8562-e8206d5a2a7a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1723 microversion: 2.20 time: 0.287096 Jan 19 13:14:26.497165 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 606/1216] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:14:26 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 13:14:27.388956 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a02b7c9a-f5f8-4b5c-96da-c0fd9ed92fed tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:27.389814 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a02b7c9a-f5f8-4b5c-96da-c0fd9ed92fed tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:27.397311 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a02b7c9a-f5f8-4b5c-96da-c0fd9ed92fed tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:27.397758 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a02b7c9a-f5f8-4b5c-96da-c0fd9ed92fed tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:27.399312 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a02b7c9a-f5f8-4b5c-96da-c0fd9ed92fed tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:27.399312 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a02b7c9a-f5f8-4b5c-96da-c0fd9ed92fed tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:27.514726 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-485fb3ab-bbe6-4bef-9d08-49d846d2a156 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:27.515592 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-485fb3ab-bbe6-4bef-9d08-49d846d2a156 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:27.523044 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-485fb3ab-bbe6-4bef-9d08-49d846d2a156 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:27.523572 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-485fb3ab-bbe6-4bef-9d08-49d846d2a156 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:27.524454 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-485fb3ab-bbe6-4bef-9d08-49d846d2a156 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:27.524901 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-485fb3ab-bbe6-4bef-9d08-49d846d2a156 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:27.605043 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-485fb3ab-bbe6-4bef-9d08-49d846d2a156 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:27.614931 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-485fb3ab-bbe6-4bef-9d08-49d846d2a156 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:27.617065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-485fb3ab-bbe6-4bef-9d08-49d846d2a156 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10527eff7ddc473396e1ce848c39c7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc6dbc546054e459498f200e327e75e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:27.618298 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-485fb3ab-bbe6-4bef-9d08-49d846d2a156 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 200 len: 1657 microversion: 2.20 time: 0.107368 Jan 19 13:14:27.618852 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 607/1217] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:14:27 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 1657 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 13:14:27.673411 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-a02b7c9a-f5f8-4b5c-96da-c0fd9ed92fed tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:27.681310 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a02b7c9a-f5f8-4b5c-96da-c0fd9ed92fed tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b" status: 200 len: 1317 microversion: 2.1 time: 0.296053 Jan 19 13:14:27.681877 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 611/1218] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:27 2022] GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:27.775541 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-7042b538-696b-41ec-8f9e-2c2160621a6f req-2f698e66-fdf7-411a-a9d3-b9402095f99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d2bd3e-47a3-4158-892e-627b3f1c1095", "name": "network-vif-deleted", "tag": "e6862281-58ef-4013-962c-3a0024140b3a"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:14:27.777164 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:14:27.777164 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:14:27.784078 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-7042b538-696b-41ec-8f9e-2c2160621a6f req-2f698e66-fdf7-411a-a9d3-b9402095f99e service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:27.784612 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-7042b538-696b-41ec-8f9e-2c2160621a6f req-2f698e66-fdf7-411a-a9d3-b9402095f99e service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:27.796575 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-7042b538-696b-41ec-8f9e-2c2160621a6f req-2f698e66-fdf7-411a-a9d3-b9402095f99e service nova] Creating event network-vif-deleted:e6862281-58ef-4013-962c-3a0024140b3a for instance 16d2bd3e-47a3-4158-892e-627b3f1c1095 on hv-cinder-82301 Jan 19 13:14:27.802481 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-7042b538-696b-41ec-8f9e-2c2160621a6f req-2f698e66-fdf7-411a-a9d3-b9402095f99e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029653 Jan 19 13:14:27.803079 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 608/1219] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:14:28.637988 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-70df74f2-a5ce-4293-a9e0-35a2f2b18346 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:28.638603 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-70df74f2-a5ce-4293-a9e0-35a2f2b18346 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:28.645835 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-70df74f2-a5ce-4293-a9e0-35a2f2b18346 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:28.646298 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-70df74f2-a5ce-4293-a9e0-35a2f2b18346 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:28.647132 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-70df74f2-a5ce-4293-a9e0-35a2f2b18346 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:28.647568 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-70df74f2-a5ce-4293-a9e0-35a2f2b18346 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:28.662776 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-70df74f2-a5ce-4293-a9e0-35a2f2b18346 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] HTTP exception thrown: Instance 16d2bd3e-47a3-4158-892e-627b3f1c1095 could not be found. Jan 19 13:14:28.663370 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-70df74f2-a5ce-4293-a9e0-35a2f2b18346 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Returning 404 to user: Instance 16d2bd3e-47a3-4158-892e-627b3f1c1095 could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:14:28.664228 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-70df74f2-a5ce-4293-a9e0-35a2f2b18346 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 404 len: 111 microversion: 2.20 time: 0.031178 Jan 19 13:14:28.664774 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 612/1220] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:14:28 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 13:14:28.673784 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2dd78359-7058-4041-945d-e3ae97cdec10 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '.version_select at 0x7f07e4697ca0>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:28.698595 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0d68f16b-7b6c-4d89-ac1e-75b413c097b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:28.699129 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2dd78359-7058-4041-945d-e3ae97cdec10 tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807079078" status: 204 len: 0 microversion: 2.20 time: 0.029691 Jan 19 13:14:28.699572 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0d68f16b-7b6c-4d89-ac1e-75b413c097b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:28.703106 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 609/1221] 10.222.0.48 () {60 vars in 1261 bytes} [Wed Jan 19 13:14:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807079078 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 19 13:14:28.706244 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0d68f16b-7b6c-4d89-ac1e-75b413c097b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:28.706804 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0d68f16b-7b6c-4d89-ac1e-75b413c097b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:28.708626 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0d68f16b-7b6c-4d89-ac1e-75b413c097b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:28.709186 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0d68f16b-7b6c-4d89-ac1e-75b413c097b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:28.858435 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0d68f16b-7b6c-4d89-ac1e-75b413c097b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:28.867724 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0d68f16b-7b6c-4d89-ac1e-75b413c097b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b" status: 200 len: 1507 microversion: 2.1 time: 0.172809 Jan 19 13:14:28.870690 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 613/1222] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:28 2022] GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:28.891884 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2285cc47-6893-4120-beb2-09a47b582ba7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7c6b7a6-2520-4a37-8b15-decbfca8c2b2"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:14:28.893028 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2285cc47-6893-4120-beb2-09a47b582ba7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:28.904406 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2285cc47-6893-4120-beb2-09a47b582ba7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:28.905208 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2285cc47-6893-4120-beb2-09a47b582ba7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:28.906615 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2285cc47-6893-4120-beb2-09a47b582ba7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:28.907525 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2285cc47-6893-4120-beb2-09a47b582ba7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:28.986859 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-2285cc47-6893-4120-beb2-09a47b582ba7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] HTTP exception thrown: Invalid volume: volume f7c6b7a6-2520-4a37-8b15-decbfca8c2b2 is already attached to instances: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 Jan 19 13:14:28.987462 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2285cc47-6893-4120-beb2-09a47b582ba7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Returning 400 to user: Invalid volume: volume f7c6b7a6-2520-4a37-8b15-decbfca8c2b2 is already attached to instances: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:14:28.988331 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2285cc47-6893-4120-beb2-09a47b582ba7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "POST /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102953 Jan 19 13:14:28.989746 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 610/1223] 10.222.0.48 () {60 vars in 1322 bytes} [Wed Jan 19 13:14:28 2022] POST /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 19 13:14:29.047573 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-fdd9b884-69a9-4699-b6db-b4b653c31642 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:29.048177 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-fdd9b884-69a9-4699-b6db-b4b653c31642 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:29.054797 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fdd9b884-69a9-4699-b6db-b4b653c31642 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:29.055450 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fdd9b884-69a9-4699-b6db-b4b653c31642 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:29.056340 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fdd9b884-69a9-4699-b6db-b4b653c31642 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:29.056851 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fdd9b884-69a9-4699-b6db-b4b653c31642 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:29.134327 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.objects.instance [None req-fdd9b884-69a9-4699-b6db-b4b653c31642 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lazy-loading 'services' on Instance uuid b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 {{(pid=116361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:14:29.202480 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-fdd9b884-69a9-4699-b6db-b4b653c31642 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6/os-volume_attachments/f7c6b7a6-2520-4a37-8b15-decbfca8c2b2" status: 202 len: 0 microversion: 2.1 time: 0.158461 Jan 19 13:14:29.203351 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 614/1224] 10.222.0.48 () {58 vars in 1415 bytes} [Wed Jan 19 13:14:29 2022] DELETE /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6/os-volume_attachments/f7c6b7a6-2520-4a37-8b15-decbfca8c2b2 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:14:29.211276 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a6974305-019d-4382-af0a-34ab37967b92 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:29.212260 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a6974305-019d-4382-af0a-34ab37967b92 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:29.219537 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a6974305-019d-4382-af0a-34ab37967b92 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:29.220112 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a6974305-019d-4382-af0a-34ab37967b92 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:29.220920 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a6974305-019d-4382-af0a-34ab37967b92 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:29.221384 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-a6974305-019d-4382-af0a-34ab37967b92 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:29.253736 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a6974305-019d-4382-af0a-34ab37967b92 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046306 Jan 19 13:14:29.255557 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 611/1225] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:14:29 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:14:30.268385 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f432a2b3-4c2c-41c7-b3e2-cd2205bc68cb tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:30.269463 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f432a2b3-4c2c-41c7-b3e2-cd2205bc68cb tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:30.275851 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f432a2b3-4c2c-41c7-b3e2-cd2205bc68cb tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:30.276398 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f432a2b3-4c2c-41c7-b3e2-cd2205bc68cb tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:30.277253 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f432a2b3-4c2c-41c7-b3e2-cd2205bc68cb tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:30.277811 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f432a2b3-4c2c-41c7-b3e2-cd2205bc68cb tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:30.307595 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f432a2b3-4c2c-41c7-b3e2-cd2205bc68cb tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043876 Jan 19 13:14:30.308173 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 615/1226] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:14:30 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:14:30.405003 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-444367801", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452", "networks": [{"uuid": "35b16c67-43df-4608-874b-8f57b3714987"}]}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:14:30.454117 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.network.neutron [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] validate_networks() for [('35b16c67-43df-4608-874b-8f57b3714987', None, None, None, None, None)] {{(pid=116360) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:14:30.503786 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-27c9b154-d9e8-46f6-b1c5-42dc44138f2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:30.504452 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-27c9b154-d9e8-46f6-b1c5-42dc44138f2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:30.511911 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27c9b154-d9e8-46f6-b1c5-42dc44138f2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:30.512461 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27c9b154-d9e8-46f6-b1c5-42dc44138f2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:30.513316 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27c9b154-d9e8-46f6-b1c5-42dc44138f2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:30.513847 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27c9b154-d9e8-46f6-b1c5-42dc44138f2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:30.529383 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-27c9b154-d9e8-46f6-b1c5-42dc44138f2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] HTTP exception thrown: Instance 16d2bd3e-47a3-4158-892e-627b3f1c1095 could not be found. Jan 19 13:14:30.529896 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-27c9b154-d9e8-46f6-b1c5-42dc44138f2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Returning 404 to user: Instance 16d2bd3e-47a3-4158-892e-627b3f1c1095 could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:14:30.530716 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-27c9b154-d9e8-46f6-b1c5-42dc44138f2d tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "DELETE /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 404 len: 111 microversion: 2.20 time: 0.030685 Jan 19 13:14:30.531255 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 616/1227] 10.222.0.48 () {60 vars in 1279 bytes} [Wed Jan 19 13:14:30 2022] DELETE /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 19 13:14:30.539360 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6fce91cf-40df-4611-9948-f43911da3e0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:30.540117 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-6fce91cf-40df-4611-9948-f43911da3e0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 16d2bd3e-47a3-4158-892e-627b3f1c1095] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:30.545674 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6fce91cf-40df-4611-9948-f43911da3e0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:30.546119 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6fce91cf-40df-4611-9948-f43911da3e0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:30.546891 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6fce91cf-40df-4611-9948-f43911da3e0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:30.547324 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-6fce91cf-40df-4611-9948-f43911da3e0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:30.560815 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-6fce91cf-40df-4611-9948-f43911da3e0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] HTTP exception thrown: Instance 16d2bd3e-47a3-4158-892e-627b3f1c1095 could not be found. Jan 19 13:14:30.561402 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-6fce91cf-40df-4611-9948-f43911da3e0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Returning 404 to user: Instance 16d2bd3e-47a3-4158-892e-627b3f1c1095 could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:14:30.562224 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-6fce91cf-40df-4611-9948-f43911da3e0a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095" status: 404 len: 111 microversion: 2.20 time: 0.027006 Jan 19 13:14:30.562758 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 617/1228] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:14:30 2022] GET /compute/v2.1/servers/16d2bd3e-47a3-4158-892e-627b3f1c1095 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 19 13:14:30.819068 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Flavor limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:14:30.819528 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Image limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:14:30.820022 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Flavor pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:14:30.820438 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Image pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:14:30.820870 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:14:30.829783 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:30.830364 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:30.831385 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:30.831930 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:30.849609 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Getting quotas for project 572a039c553a406a96e802aa59566f87. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:14:30.853963 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Getting quotas for user a910cea139a54d91b857994060c3ba42 and project 572a039c553a406a96e802aa59566f87. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:14:30.866291 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Going to run 1 instances... {{(pid=116360) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:14:30.869493 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:14:30.918584 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e90398b2-50be-45a6-8feb-6220f14d0bec tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517187 Jan 19 13:14:30.919252 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 612/1229] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:14:30.928914 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a2ce4d05-ee13-4fca-9532-81c042bd15d3 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:30.929627 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a2ce4d05-ee13-4fca-9532-81c042bd15d3 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:30.982494 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-a2ce4d05-ee13-4fca-9532-81c042bd15d3 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:30.989098 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a2ce4d05-ee13-4fca-9532-81c042bd15d3 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133" status: 200 len: 1217 microversion: 2.1 time: 0.063949 Jan 19 13:14:30.989661 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 618/1230] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:30 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:31.692946 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-df42fc5b-0a99-48e4-9eeb-e2d7c3b29e1a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:31.693474 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-df42fc5b-0a99-48e4-9eeb-e2d7c3b29e1a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:31.699952 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-df42fc5b-0a99-48e4-9eeb-e2d7c3b29e1a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:31.700433 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-df42fc5b-0a99-48e4-9eeb-e2d7c3b29e1a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:31.701218 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-df42fc5b-0a99-48e4-9eeb-e2d7c3b29e1a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:31.701657 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-df42fc5b-0a99-48e4-9eeb-e2d7c3b29e1a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:31.717082 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-df42fc5b-0a99-48e4-9eeb-e2d7c3b29e1a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] HTTP exception thrown: Instance 0a2fc94f-e55f-4947-9824-ffc6edf35e0c could not be found. Jan 19 13:14:31.717707 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-df42fc5b-0a99-48e4-9eeb-e2d7c3b29e1a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Returning 404 to user: Instance 0a2fc94f-e55f-4947-9824-ffc6edf35e0c could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:14:31.718539 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-df42fc5b-0a99-48e4-9eeb-e2d7c3b29e1a tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 404 len: 111 microversion: 2.20 time: 0.030451 Jan 19 13:14:31.719085 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 613/1231] 10.222.0.48 () {60 vars in 1279 bytes} [Wed Jan 19 13:14:31 2022] DELETE /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 13:14:31.726830 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0ebe960a-8782-4e7d-8f3d-0ddb62e6683e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:31.727437 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0ebe960a-8782-4e7d-8f3d-0ddb62e6683e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] [instance: 0a2fc94f-e55f-4947-9824-ffc6edf35e0c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:31.735485 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0ebe960a-8782-4e7d-8f3d-0ddb62e6683e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:31.736232 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0ebe960a-8782-4e7d-8f3d-0ddb62e6683e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:31.737015 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0ebe960a-8782-4e7d-8f3d-0ddb62e6683e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:31.737445 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-0ebe960a-8782-4e7d-8f3d-0ddb62e6683e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:31.750983 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-0ebe960a-8782-4e7d-8f3d-0ddb62e6683e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] HTTP exception thrown: Instance 0a2fc94f-e55f-4947-9824-ffc6edf35e0c could not be found. Jan 19 13:14:31.751574 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0ebe960a-8782-4e7d-8f3d-0ddb62e6683e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] Returning 404 to user: Instance 0a2fc94f-e55f-4947-9824-ffc6edf35e0c could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:14:31.752585 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0ebe960a-8782-4e7d-8f3d-0ddb62e6683e tempest-AttachVolumeShelveTestJSON-1444560180 tempest-AttachVolumeShelveTestJSON-1444560180-project] 10.222.0.48 "GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c" status: 404 len: 111 microversion: 2.20 time: 0.029300 Jan 19 13:14:31.753146 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 619/1232] 10.222.0.48 () {60 vars in 1276 bytes} [Wed Jan 19 13:14:31 2022] GET /compute/v2.1/servers/0a2fc94f-e55f-4947-9824-ffc6edf35e0c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 13:14:32.006621 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f81038b5-6fcf-46cf-a2c6-70d908c6803f tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:32.007324 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f81038b5-6fcf-46cf-a2c6-70d908c6803f tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:32.013349 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f81038b5-6fcf-46cf-a2c6-70d908c6803f tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:32.013880 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f81038b5-6fcf-46cf-a2c6-70d908c6803f tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:32.014739 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f81038b5-6fcf-46cf-a2c6-70d908c6803f tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:32.015250 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f81038b5-6fcf-46cf-a2c6-70d908c6803f tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:32.140094 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f81038b5-6fcf-46cf-a2c6-70d908c6803f tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:32.147474 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f81038b5-6fcf-46cf-a2c6-70d908c6803f tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133" status: 200 len: 1275 microversion: 2.1 time: 0.145449 Jan 19 13:14:32.148054 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 614/1233] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:32 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133 => generated 1275 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:33.164240 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c553bed3-0b12-415d-b775-8c62f7559202 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:33.164823 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c553bed3-0b12-415d-b775-8c62f7559202 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:33.171272 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c553bed3-0b12-415d-b775-8c62f7559202 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:33.171724 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c553bed3-0b12-415d-b775-8c62f7559202 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:33.172613 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c553bed3-0b12-415d-b775-8c62f7559202 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:33.173054 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c553bed3-0b12-415d-b775-8c62f7559202 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:33.490532 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-c553bed3-0b12-415d-b775-8c62f7559202 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:33.498001 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c553bed3-0b12-415d-b775-8c62f7559202 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133" status: 200 len: 1317 microversion: 2.1 time: 0.337622 Jan 19 13:14:33.498570 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 620/1234] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:33 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:14:34.339048 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-f4f88a9f-ef00-4f55-98b7-7a71409fabec req-8e581946-f379-4d95-95ce-ab7cf79344ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8cfb85-c720-4bf9-b224-7787e0314133", "tag": "771e9a17-d878-477d-b112-efecdb278d60"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:14:34.341349 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:14:34.341349 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:14:34.352450 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-f4f88a9f-ef00-4f55-98b7-7a71409fabec req-8e581946-f379-4d95-95ce-ab7cf79344ce service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:34.352934 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-f4f88a9f-ef00-4f55-98b7-7a71409fabec req-8e581946-f379-4d95-95ce-ab7cf79344ce service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:34.369330 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-f4f88a9f-ef00-4f55-98b7-7a71409fabec req-8e581946-f379-4d95-95ce-ab7cf79344ce service nova] Creating event network-changed:771e9a17-d878-477d-b112-efecdb278d60 for instance aa8cfb85-c720-4bf9-b224-7787e0314133 on hv-cinder-82301 Jan 19 13:14:34.376093 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-f4f88a9f-ef00-4f55-98b7-7a71409fabec req-8e581946-f379-4d95-95ce-ab7cf79344ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040119 Jan 19 13:14:34.377301 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 615/1235] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:14:34.514525 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4a01a309-2d4f-4669-9dab-e0d27a417f63 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:34.515148 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4a01a309-2d4f-4669-9dab-e0d27a417f63 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:34.522326 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4a01a309-2d4f-4669-9dab-e0d27a417f63 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:34.522781 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4a01a309-2d4f-4669-9dab-e0d27a417f63 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:34.523578 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4a01a309-2d4f-4669-9dab-e0d27a417f63 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:34.524089 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4a01a309-2d4f-4669-9dab-e0d27a417f63 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:34.846608 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4a01a309-2d4f-4669-9dab-e0d27a417f63 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:34.860944 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4a01a309-2d4f-4669-9dab-e0d27a417f63 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133" status: 200 len: 1317 microversion: 2.1 time: 0.350055 Jan 19 13:14:34.861764 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 621/1236] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:34 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133 => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:14:35.882684 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-633cbf40-828d-4dea-a492-71b5787bf67a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:35.883388 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-633cbf40-828d-4dea-a492-71b5787bf67a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:35.891862 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-633cbf40-828d-4dea-a492-71b5787bf67a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:35.892341 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-633cbf40-828d-4dea-a492-71b5787bf67a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:35.893134 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-633cbf40-828d-4dea-a492-71b5787bf67a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:35.893576 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-633cbf40-828d-4dea-a492-71b5787bf67a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:36.026950 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-633cbf40-828d-4dea-a492-71b5787bf67a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:36.034365 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-633cbf40-828d-4dea-a492-71b5787bf67a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133" status: 200 len: 1317 microversion: 2.1 time: 0.156117 Jan 19 13:14:36.035062 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 616/1237] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:35 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:37.052736 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-70a474d9-57cd-4a3e-92d6-248ebe6720d0 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:37.053253 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-70a474d9-57cd-4a3e-92d6-248ebe6720d0 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:37.059430 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-70a474d9-57cd-4a3e-92d6-248ebe6720d0 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:37.059932 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-70a474d9-57cd-4a3e-92d6-248ebe6720d0 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:37.060765 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-70a474d9-57cd-4a3e-92d6-248ebe6720d0 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:37.061206 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-70a474d9-57cd-4a3e-92d6-248ebe6720d0 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:37.197473 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-70a474d9-57cd-4a3e-92d6-248ebe6720d0 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:37.204788 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-70a474d9-57cd-4a3e-92d6-248ebe6720d0 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133" status: 200 len: 1317 microversion: 2.1 time: 0.157019 Jan 19 13:14:37.205345 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 622/1238] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:37 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:38.221519 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-90245501-53fe-419f-84bf-08fd666dbcc9 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:38.222179 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-90245501-53fe-419f-84bf-08fd666dbcc9 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:38.229613 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-90245501-53fe-419f-84bf-08fd666dbcc9 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:38.230066 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-90245501-53fe-419f-84bf-08fd666dbcc9 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:38.230849 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-90245501-53fe-419f-84bf-08fd666dbcc9 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:38.231319 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-90245501-53fe-419f-84bf-08fd666dbcc9 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:38.361094 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-90245501-53fe-419f-84bf-08fd666dbcc9 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:38.369084 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-90245501-53fe-419f-84bf-08fd666dbcc9 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133" status: 200 len: 1317 microversion: 2.1 time: 0.151273 Jan 19 13:14:38.369662 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 617/1239] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:38 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:39.386045 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5a67b8ea-56a6-4dda-bcb2-eaceb274ff99 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:39.386655 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5a67b8ea-56a6-4dda-bcb2-eaceb274ff99 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:39.392544 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5a67b8ea-56a6-4dda-bcb2-eaceb274ff99 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:39.393015 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5a67b8ea-56a6-4dda-bcb2-eaceb274ff99 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:39.394198 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5a67b8ea-56a6-4dda-bcb2-eaceb274ff99 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:39.395278 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5a67b8ea-56a6-4dda-bcb2-eaceb274ff99 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:39.527868 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5a67b8ea-56a6-4dda-bcb2-eaceb274ff99 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:39.535133 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5a67b8ea-56a6-4dda-bcb2-eaceb274ff99 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133" status: 200 len: 1317 microversion: 2.1 time: 0.153023 Jan 19 13:14:39.536279 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 623/1240] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:39 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:39.946636 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-4f4fbf72-35b5-4f0c-8be1-948385ec9edb req-c3d882f1-8c8e-46d5-a8c5-cc5c8da21254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8cfb85-c720-4bf9-b224-7787e0314133", "name": "network-vif-plugged", "status": "completed", "tag": "771e9a17-d878-477d-b112-efecdb278d60"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:14:39.948226 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:14:39.948226 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:14:39.956662 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-4f4fbf72-35b5-4f0c-8be1-948385ec9edb req-c3d882f1-8c8e-46d5-a8c5-cc5c8da21254 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:39.958500 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-4f4fbf72-35b5-4f0c-8be1-948385ec9edb req-c3d882f1-8c8e-46d5-a8c5-cc5c8da21254 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:39.970098 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-4f4fbf72-35b5-4f0c-8be1-948385ec9edb req-c3d882f1-8c8e-46d5-a8c5-cc5c8da21254 service nova] Creating event network-vif-plugged:771e9a17-d878-477d-b112-efecdb278d60 for instance aa8cfb85-c720-4bf9-b224-7787e0314133 on hv-cinder-82301 Jan 19 13:14:39.975473 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-4f4fbf72-35b5-4f0c-8be1-948385ec9edb req-c3d882f1-8c8e-46d5-a8c5-cc5c8da21254 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033633 Jan 19 13:14:39.976674 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 618/1241] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:14:40.552652 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d39be198-5ac6-4ec8-9ada-dd5575a2a876 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:40.553267 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d39be198-5ac6-4ec8-9ada-dd5575a2a876 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:40.559564 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d39be198-5ac6-4ec8-9ada-dd5575a2a876 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:40.560045 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d39be198-5ac6-4ec8-9ada-dd5575a2a876 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:40.560836 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d39be198-5ac6-4ec8-9ada-dd5575a2a876 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:40.561276 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d39be198-5ac6-4ec8-9ada-dd5575a2a876 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:40.704330 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d39be198-5ac6-4ec8-9ada-dd5575a2a876 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:40.712185 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d39be198-5ac6-4ec8-9ada-dd5575a2a876 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133" status: 200 len: 1317 microversion: 2.1 time: 0.164006 Jan 19 13:14:40.712890 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 624/1242] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:40 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:41.729348 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4a64509f-2d15-4d3a-9191-a6e68489c7b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:41.730267 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4a64509f-2d15-4d3a-9191-a6e68489c7b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:41.736556 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4a64509f-2d15-4d3a-9191-a6e68489c7b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:41.737003 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4a64509f-2d15-4d3a-9191-a6e68489c7b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:41.737777 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4a64509f-2d15-4d3a-9191-a6e68489c7b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:41.738209 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4a64509f-2d15-4d3a-9191-a6e68489c7b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:41.874373 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4a64509f-2d15-4d3a-9191-a6e68489c7b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:41.882802 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4a64509f-2d15-4d3a-9191-a6e68489c7b7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133" status: 200 len: 1507 microversion: 2.1 time: 0.158465 Jan 19 13:14:41.883385 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 619/1243] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:41 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:43.209437 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-cbe4deef-762a-4b48-a3a9-310bf1c3e6d5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc733d7e-d48a-47e2-8c80-98b694531b92"}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:14:43.210487 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-cbe4deef-762a-4b48-a3a9-310bf1c3e6d5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:43.216933 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cbe4deef-762a-4b48-a3a9-310bf1c3e6d5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:43.217376 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cbe4deef-762a-4b48-a3a9-310bf1c3e6d5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:43.218161 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cbe4deef-762a-4b48-a3a9-310bf1c3e6d5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:43.218595 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cbe4deef-762a-4b48-a3a9-310bf1c3e6d5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:43.459038 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-cbe4deef-762a-4b48-a3a9-310bf1c3e6d5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "POST /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253464 Jan 19 13:14:43.459640 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 625/1244] 10.222.0.48 () {60 vars in 1322 bytes} [Wed Jan 19 13:14:43 2022] POST /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:14:50.927706 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7c4c134f-727b-42a8-acd3-9e4623a0c67d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc733d7e-d48a-47e2-8c80-98b694531b92"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:14:50.928795 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7c4c134f-727b-42a8-acd3-9e4623a0c67d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:50.935051 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7c4c134f-727b-42a8-acd3-9e4623a0c67d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:50.935512 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7c4c134f-727b-42a8-acd3-9e4623a0c67d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:50.936323 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7c4c134f-727b-42a8-acd3-9e4623a0c67d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:50.936775 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-7c4c134f-727b-42a8-acd3-9e4623a0c67d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:51.014071 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-7c4c134f-727b-42a8-acd3-9e4623a0c67d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] HTTP exception thrown: Invalid volume: volume fc733d7e-d48a-47e2-8c80-98b694531b92 is already attached to instances: aa8cfb85-c720-4bf9-b224-7787e0314133 Jan 19 13:14:51.014658 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7c4c134f-727b-42a8-acd3-9e4623a0c67d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Returning 400 to user: Invalid volume: volume fc733d7e-d48a-47e2-8c80-98b694531b92 is already attached to instances: aa8cfb85-c720-4bf9-b224-7787e0314133 {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:14:51.015539 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7c4c134f-727b-42a8-acd3-9e4623a0c67d tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "POST /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092213 Jan 19 13:14:51.016096 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 620/1245] 10.222.0.48 () {60 vars in 1322 bytes} [Wed Jan 19 13:14:50 2022] POST /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 13:14:51.076713 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f002fc84-c106-47eb-bdc5-5e7170dcca33 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:51.077300 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f002fc84-c106-47eb-bdc5-5e7170dcca33 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:51.083546 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f002fc84-c106-47eb-bdc5-5e7170dcca33 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:51.083937 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f002fc84-c106-47eb-bdc5-5e7170dcca33 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:51.084747 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f002fc84-c106-47eb-bdc5-5e7170dcca33 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:51.085204 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f002fc84-c106-47eb-bdc5-5e7170dcca33 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:51.163340 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.objects.instance [None req-f002fc84-c106-47eb-bdc5-5e7170dcca33 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lazy-loading 'services' on Instance uuid aa8cfb85-c720-4bf9-b224-7787e0314133 {{(pid=116361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:14:51.235511 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f002fc84-c106-47eb-bdc5-5e7170dcca33 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133/os-volume_attachments/fc733d7e-d48a-47e2-8c80-98b694531b92" status: 202 len: 0 microversion: 2.1 time: 0.163260 Jan 19 13:14:51.236804 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 626/1246] 10.222.0.48 () {58 vars in 1415 bytes} [Wed Jan 19 13:14:51 2022] DELETE /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133/os-volume_attachments/fc733d7e-d48a-47e2-8c80-98b694531b92 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:14:51.245950 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f67dc196-e971-432a-9931-6b6af3213796 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:51.247239 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f67dc196-e971-432a-9931-6b6af3213796 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:51.254195 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f67dc196-e971-432a-9931-6b6af3213796 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:51.254914 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f67dc196-e971-432a-9931-6b6af3213796 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:51.255959 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f67dc196-e971-432a-9931-6b6af3213796 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:51.256559 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f67dc196-e971-432a-9931-6b6af3213796 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:51.289838 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f67dc196-e971-432a-9931-6b6af3213796 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047962 Jan 19 13:14:51.290407 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 621/1247] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:14:51 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:14:52.302849 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f8eaec15-5647-4d2c-bea8-8658eb23b7e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:52.303811 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f8eaec15-5647-4d2c-bea8-8658eb23b7e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:52.309940 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f8eaec15-5647-4d2c-bea8-8658eb23b7e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:52.310398 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f8eaec15-5647-4d2c-bea8-8658eb23b7e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:52.311206 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f8eaec15-5647-4d2c-bea8-8658eb23b7e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:52.311643 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f8eaec15-5647-4d2c-bea8-8658eb23b7e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:52.343547 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f8eaec15-5647-4d2c-bea8-8658eb23b7e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045837 Jan 19 13:14:52.344139 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 627/1248] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:14:52 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:14:52.494909 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1621056961", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452", "networks": [{"uuid": "35b16c67-43df-4608-874b-8f57b3714987"}]}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:14:52.543995 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.network.neutron [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] validate_networks() for [('35b16c67-43df-4608-874b-8f57b3714987', None, None, None, None, None)] {{(pid=116360) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:14:52.925263 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Flavor limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:14:52.925678 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Image limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:14:52.926139 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Flavor pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:14:52.926538 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Image pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:14:52.926939 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:14:52.935607 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:52.936088 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:52.936884 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:52.937313 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:52.954403 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Getting quotas for project 572a039c553a406a96e802aa59566f87. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:14:52.958936 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Getting quotas for user a910cea139a54d91b857994060c3ba42 and project 572a039c553a406a96e802aa59566f87. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:14:52.970207 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Going to run 1 instances... {{(pid=116360) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:14:52.972823 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:14:53.016969 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3d04c020-ab0a-4684-9835-5c43e670ee94 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525971 Jan 19 13:14:53.017929 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 622/1249] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:14:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:14:53.027642 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e1d8bfb0-c4a2-4b70-8185-9593082ecc66 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:53.028412 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e1d8bfb0-c4a2-4b70-8185-9593082ecc66 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:53.087022 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e1d8bfb0-c4a2-4b70-8185-9593082ecc66 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:53.093653 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e1d8bfb0-c4a2-4b70-8185-9593082ecc66 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c" status: 200 len: 1218 microversion: 2.1 time: 0.069769 Jan 19 13:14:53.094223 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 628/1250] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:53 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:54.110613 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d5f15bb0-4829-4a0c-8d4e-a6ec6af08bbb tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:54.111293 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d5f15bb0-4829-4a0c-8d4e-a6ec6af08bbb tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:54.119526 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d5f15bb0-4829-4a0c-8d4e-a6ec6af08bbb tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:54.119999 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d5f15bb0-4829-4a0c-8d4e-a6ec6af08bbb tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:54.120785 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d5f15bb0-4829-4a0c-8d4e-a6ec6af08bbb tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:54.121409 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d5f15bb0-4829-4a0c-8d4e-a6ec6af08bbb tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:54.192630 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d5f15bb0-4829-4a0c-8d4e-a6ec6af08bbb tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:54.200856 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d5f15bb0-4829-4a0c-8d4e-a6ec6af08bbb tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c" status: 200 len: 1276 microversion: 2.1 time: 0.094007 Jan 19 13:14:54.201679 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 623/1251] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:54 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:55.218776 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-11fe3f7f-cdb8-491f-b042-3f4225851552 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:55.219454 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-11fe3f7f-cdb8-491f-b042-3f4225851552 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:55.229166 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-11fe3f7f-cdb8-491f-b042-3f4225851552 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:55.229623 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-11fe3f7f-cdb8-491f-b042-3f4225851552 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:55.233842 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-11fe3f7f-cdb8-491f-b042-3f4225851552 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:55.234766 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-11fe3f7f-cdb8-491f-b042-3f4225851552 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:55.453049 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-11fe3f7f-cdb8-491f-b042-3f4225851552 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:55.462201 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-11fe3f7f-cdb8-491f-b042-3f4225851552 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c" status: 200 len: 1318 microversion: 2.1 time: 0.247745 Jan 19 13:14:55.462911 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 629/1252] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:55 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:55.546051 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-b3f32f8b-e055-4a32-b0fa-a9c1b609de17 req-cc594aad-5d88-46a4-a6ba-5bb8af225ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ab993a-e1be-450c-99c7-637403460d5c", "tag": "5f8ad3b5-4989-4feb-9282-62aa8f765152"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:14:55.547940 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:14:55.547940 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:14:55.557794 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-b3f32f8b-e055-4a32-b0fa-a9c1b609de17 req-cc594aad-5d88-46a4-a6ba-5bb8af225ac0 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:55.558243 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-b3f32f8b-e055-4a32-b0fa-a9c1b609de17 req-cc594aad-5d88-46a4-a6ba-5bb8af225ac0 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:55.569517 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-b3f32f8b-e055-4a32-b0fa-a9c1b609de17 req-cc594aad-5d88-46a4-a6ba-5bb8af225ac0 service nova] Creating event network-changed:5f8ad3b5-4989-4feb-9282-62aa8f765152 for instance b4ab993a-e1be-450c-99c7-637403460d5c on hv-cinder-82301 Jan 19 13:14:55.574848 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-b3f32f8b-e055-4a32-b0fa-a9c1b609de17 req-cc594aad-5d88-46a4-a6ba-5bb8af225ac0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032319 Jan 19 13:14:55.575830 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 624/1253] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:14:56.478766 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-89b98636-92e3-45e8-b86c-8a9bb4a586c3 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:56.479376 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-89b98636-92e3-45e8-b86c-8a9bb4a586c3 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:56.485892 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-89b98636-92e3-45e8-b86c-8a9bb4a586c3 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:56.486404 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-89b98636-92e3-45e8-b86c-8a9bb4a586c3 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:56.487300 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-89b98636-92e3-45e8-b86c-8a9bb4a586c3 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:56.488405 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-89b98636-92e3-45e8-b86c-8a9bb4a586c3 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:56.623130 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-89b98636-92e3-45e8-b86c-8a9bb4a586c3 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:56.631214 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-89b98636-92e3-45e8-b86c-8a9bb4a586c3 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c" status: 200 len: 1318 microversion: 2.1 time: 0.155852 Jan 19 13:14:56.631774 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 630/1254] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:56 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:57.648834 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f362cbb8-f079-4220-9c86-254b0cbfc563 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:57.649554 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f362cbb8-f079-4220-9c86-254b0cbfc563 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:57.655491 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f362cbb8-f079-4220-9c86-254b0cbfc563 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:57.655937 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f362cbb8-f079-4220-9c86-254b0cbfc563 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:57.656740 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f362cbb8-f079-4220-9c86-254b0cbfc563 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:57.657174 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f362cbb8-f079-4220-9c86-254b0cbfc563 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:58.042696 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f362cbb8-f079-4220-9c86-254b0cbfc563 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:58.049814 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f362cbb8-f079-4220-9c86-254b0cbfc563 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c" status: 200 len: 1318 microversion: 2.1 time: 0.405998 Jan 19 13:14:58.050371 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 625/1255] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:57 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:14:59.066477 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e47c1c1f-182f-4de9-ba34-2b363f6586b5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:14:59.067247 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e47c1c1f-182f-4de9-ba34-2b363f6586b5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:14:59.073480 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e47c1c1f-182f-4de9-ba34-2b363f6586b5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:59.073934 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e47c1c1f-182f-4de9-ba34-2b363f6586b5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:59.074719 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e47c1c1f-182f-4de9-ba34-2b363f6586b5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:14:59.075159 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e47c1c1f-182f-4de9-ba34-2b363f6586b5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:14:59.212299 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e47c1c1f-182f-4de9-ba34-2b363f6586b5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:14:59.219610 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e47c1c1f-182f-4de9-ba34-2b363f6586b5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c" status: 200 len: 1318 microversion: 2.1 time: 0.156942 Jan 19 13:14:59.220297 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 631/1256] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:14:59 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:15:00.237415 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-d70d19ec-524a-4828-bf63-8e5a678cd27e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:00.239756 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-d70d19ec-524a-4828-bf63-8e5a678cd27e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:00.245884 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d70d19ec-524a-4828-bf63-8e5a678cd27e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:00.246357 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d70d19ec-524a-4828-bf63-8e5a678cd27e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:00.247167 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d70d19ec-524a-4828-bf63-8e5a678cd27e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:00.247606 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-d70d19ec-524a-4828-bf63-8e5a678cd27e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:00.416833 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-d70d19ec-524a-4828-bf63-8e5a678cd27e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:00.426882 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-d70d19ec-524a-4828-bf63-8e5a678cd27e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c" status: 200 len: 1318 microversion: 2.1 time: 0.192952 Jan 19 13:15:00.427808 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 626/1257] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:00 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:15:01.444225 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-05bfb40f-4f91-43bc-b21e-8ceabee72a5e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:01.444839 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-05bfb40f-4f91-43bc-b21e-8ceabee72a5e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:01.451074 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05bfb40f-4f91-43bc-b21e-8ceabee72a5e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:01.451534 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05bfb40f-4f91-43bc-b21e-8ceabee72a5e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:01.452347 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05bfb40f-4f91-43bc-b21e-8ceabee72a5e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:01.452788 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-05bfb40f-4f91-43bc-b21e-8ceabee72a5e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:01.582112 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-05bfb40f-4f91-43bc-b21e-8ceabee72a5e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:01.595646 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-05bfb40f-4f91-43bc-b21e-8ceabee72a5e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c" status: 200 len: 1318 microversion: 2.1 time: 0.155485 Jan 19 13:15:01.598344 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 632/1258] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:01 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:15:02.077064 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-e1e05d19-0a49-4d3d-9f11-2d86474bc555 req-ba74c23d-b905-426a-a076-0c13e6d2b8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ab993a-e1be-450c-99c7-637403460d5c", "name": "network-vif-plugged", "status": "completed", "tag": "5f8ad3b5-4989-4feb-9282-62aa8f765152"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:15:02.078910 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:15:02.078910 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:15:02.087872 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-e1e05d19-0a49-4d3d-9f11-2d86474bc555 req-ba74c23d-b905-426a-a076-0c13e6d2b8d4 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:02.088648 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-e1e05d19-0a49-4d3d-9f11-2d86474bc555 req-ba74c23d-b905-426a-a076-0c13e6d2b8d4 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:02.100674 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-e1e05d19-0a49-4d3d-9f11-2d86474bc555 req-ba74c23d-b905-426a-a076-0c13e6d2b8d4 service nova] Creating event network-vif-plugged:5f8ad3b5-4989-4feb-9282-62aa8f765152 for instance b4ab993a-e1be-450c-99c7-637403460d5c on hv-cinder-82301 Jan 19 13:15:02.105700 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-e1e05d19-0a49-4d3d-9f11-2d86474bc555 req-ba74c23d-b905-426a-a076-0c13e6d2b8d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032581 Jan 19 13:15:02.106286 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 627/1259] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:15:02.614882 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-54650a8b-b50e-443a-a160-5b531785e7d2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:02.615596 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-54650a8b-b50e-443a-a160-5b531785e7d2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:02.621906 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54650a8b-b50e-443a-a160-5b531785e7d2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:02.622259 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54650a8b-b50e-443a-a160-5b531785e7d2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:02.623037 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54650a8b-b50e-443a-a160-5b531785e7d2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:02.623476 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54650a8b-b50e-443a-a160-5b531785e7d2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:02.762621 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-54650a8b-b50e-443a-a160-5b531785e7d2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:02.770255 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-54650a8b-b50e-443a-a160-5b531785e7d2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c" status: 200 len: 1318 microversion: 2.1 time: 0.159524 Jan 19 13:15:02.772058 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 633/1260] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:02 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:15:03.790015 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c220b51c-e670-43fd-834e-1a936c379702 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:03.791391 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c220b51c-e670-43fd-834e-1a936c379702 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:03.798697 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c220b51c-e670-43fd-834e-1a936c379702 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:03.799404 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c220b51c-e670-43fd-834e-1a936c379702 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:03.800439 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c220b51c-e670-43fd-834e-1a936c379702 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:03.800984 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c220b51c-e670-43fd-834e-1a936c379702 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:03.945173 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c220b51c-e670-43fd-834e-1a936c379702 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:03.953132 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c220b51c-e670-43fd-834e-1a936c379702 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c" status: 200 len: 1508 microversion: 2.1 time: 0.168601 Jan 19 13:15:03.953699 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 628/1261] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:03 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:15:05.269753 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e3e8c0e6-09f8-4275-8d28-e3f6dd835ab9 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9aa96ddc-0e0e-483c-a051-4bb69497d824"}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:15:05.270908 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e3e8c0e6-09f8-4275-8d28-e3f6dd835ab9 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:05.277221 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3e8c0e6-09f8-4275-8d28-e3f6dd835ab9 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:05.277677 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3e8c0e6-09f8-4275-8d28-e3f6dd835ab9 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:05.278457 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3e8c0e6-09f8-4275-8d28-e3f6dd835ab9 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:05.279045 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3e8c0e6-09f8-4275-8d28-e3f6dd835ab9 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:05.511661 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e3e8c0e6-09f8-4275-8d28-e3f6dd835ab9 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "POST /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245581 Jan 19 13:15:05.516881 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 634/1262] 10.222.0.48 () {60 vars in 1322 bytes} [Wed Jan 19 13:15:05 2022] POST /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:15:13.062940 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f41ba6c7-91ea-4e3f-94d9-45133fef8cae tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:13.063415 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f41ba6c7-91ea-4e3f-94d9-45133fef8cae tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:13.070169 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f41ba6c7-91ea-4e3f-94d9-45133fef8cae tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:13.070612 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f41ba6c7-91ea-4e3f-94d9-45133fef8cae tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:13.071379 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f41ba6c7-91ea-4e3f-94d9-45133fef8cae tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:13.071811 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f41ba6c7-91ea-4e3f-94d9-45133fef8cae tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:13.149080 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.objects.instance [None req-f41ba6c7-91ea-4e3f-94d9-45133fef8cae tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lazy-loading 'services' on Instance uuid b4ab993a-e1be-450c-99c7-637403460d5c {{(pid=116360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:15:13.217745 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f41ba6c7-91ea-4e3f-94d9-45133fef8cae tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments/9aa96ddc-0e0e-483c-a051-4bb69497d824" status: 202 len: 0 microversion: 2.1 time: 0.158534 Jan 19 13:15:13.221741 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 629/1263] 10.222.0.48 () {58 vars in 1415 bytes} [Wed Jan 19 13:15:13 2022] DELETE /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments/9aa96ddc-0e0e-483c-a051-4bb69497d824 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:15:13.227955 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-542defa4-1794-4806-919b-06e11dd6be34 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:13.229623 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-542defa4-1794-4806-919b-06e11dd6be34 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:13.236969 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-542defa4-1794-4806-919b-06e11dd6be34 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:13.237647 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-542defa4-1794-4806-919b-06e11dd6be34 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:13.238725 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-542defa4-1794-4806-919b-06e11dd6be34 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:13.239207 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-542defa4-1794-4806-919b-06e11dd6be34 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:13.272786 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-542defa4-1794-4806-919b-06e11dd6be34 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049407 Jan 19 13:15:13.273673 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 635/1264] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:15:13 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:15:14.285338 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-33e3148d-8e82-4a0b-9072-b7b61af17ac4 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:14.286345 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-33e3148d-8e82-4a0b-9072-b7b61af17ac4 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:14.293885 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-33e3148d-8e82-4a0b-9072-b7b61af17ac4 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:14.294337 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-33e3148d-8e82-4a0b-9072-b7b61af17ac4 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:14.295112 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-33e3148d-8e82-4a0b-9072-b7b61af17ac4 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:14.295554 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-33e3148d-8e82-4a0b-9072-b7b61af17ac4 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:14.324344 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-33e3148d-8e82-4a0b-9072-b7b61af17ac4 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043072 Jan 19 13:15:14.324893 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 630/1265] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:15:14 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:15:15.336064 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-1d6bc41d-2494-4fee-8432-178d1849d92b tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:15.336958 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-1d6bc41d-2494-4fee-8432-178d1849d92b tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:15.343284 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1d6bc41d-2494-4fee-8432-178d1849d92b tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:15.343741 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1d6bc41d-2494-4fee-8432-178d1849d92b tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:15.344557 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1d6bc41d-2494-4fee-8432-178d1849d92b tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:15.345002 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-1d6bc41d-2494-4fee-8432-178d1849d92b tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:15.373578 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-1d6bc41d-2494-4fee-8432-178d1849d92b tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041552 Jan 19 13:15:15.374127 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 636/1266] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:15:15 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:15:16.385349 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5762e3cb-99ca-409a-9db5-637971ddd6b2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:16.386268 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5762e3cb-99ca-409a-9db5-637971ddd6b2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:16.392560 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5762e3cb-99ca-409a-9db5-637971ddd6b2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:16.393017 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5762e3cb-99ca-409a-9db5-637971ddd6b2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:16.393793 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5762e3cb-99ca-409a-9db5-637971ddd6b2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:16.394232 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5762e3cb-99ca-409a-9db5-637971ddd6b2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:16.423874 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5762e3cb-99ca-409a-9db5-637971ddd6b2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042385 Jan 19 13:15:16.424454 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 631/1267] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:15:16 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:15:17.434659 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-276f5386-51fd-42ec-9025-a8a570441bbe tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:17.435575 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-276f5386-51fd-42ec-9025-a8a570441bbe tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:17.441883 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-276f5386-51fd-42ec-9025-a8a570441bbe tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:17.442370 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-276f5386-51fd-42ec-9025-a8a570441bbe tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:17.443267 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-276f5386-51fd-42ec-9025-a8a570441bbe tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:17.443717 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-276f5386-51fd-42ec-9025-a8a570441bbe tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:17.471703 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-276f5386-51fd-42ec-9025-a8a570441bbe tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040808 Jan 19 13:15:17.472288 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 637/1268] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:15:17 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:15:18.483624 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-78d98547-6286-4d8a-910f-2ecad0c1bed5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:18.484628 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-78d98547-6286-4d8a-910f-2ecad0c1bed5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:18.491567 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-78d98547-6286-4d8a-910f-2ecad0c1bed5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:18.492149 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-78d98547-6286-4d8a-910f-2ecad0c1bed5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:18.492931 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-78d98547-6286-4d8a-910f-2ecad0c1bed5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:18.493375 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-78d98547-6286-4d8a-910f-2ecad0c1bed5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:18.522726 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-78d98547-6286-4d8a-910f-2ecad0c1bed5 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042905 Jan 19 13:15:18.523269 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 632/1269] 10.222.0.48 () {58 vars in 1301 bytes} [Wed Jan 19 13:15:18 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 13:15:19.696442 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b46b235d-15c6-4b75-be61-e56daac2fcbe tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:19.696925 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b46b235d-15c6-4b75-be61-e56daac2fcbe tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:19.703173 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b46b235d-15c6-4b75-be61-e56daac2fcbe tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:19.703628 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b46b235d-15c6-4b75-be61-e56daac2fcbe tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:19.704444 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b46b235d-15c6-4b75-be61-e56daac2fcbe tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:19.704883 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b46b235d-15c6-4b75-be61-e56daac2fcbe tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:19.729509 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b46b235d-15c6-4b75-be61-e56daac2fcbe tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Going to try to terminate instance {{(pid=116361) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:15:19.801071 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b46b235d-15c6-4b75-be61-e56daac2fcbe tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c" status: 204 len: 0 microversion: 2.1 time: 0.108687 Jan 19 13:15:19.801650 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 638/1270] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:15:19 2022] DELETE /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:15:19.810433 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-bf4f3ef9-8e62-4125-848b-afdfdccfbc97 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:19.811113 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-bf4f3ef9-8e62-4125-848b-afdfdccfbc97 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:19.817421 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bf4f3ef9-8e62-4125-848b-afdfdccfbc97 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:19.818608 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bf4f3ef9-8e62-4125-848b-afdfdccfbc97 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:19.819392 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bf4f3ef9-8e62-4125-848b-afdfdccfbc97 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:19.819953 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-bf4f3ef9-8e62-4125-848b-afdfdccfbc97 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:19.951549 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-bf4f3ef9-8e62-4125-848b-afdfdccfbc97 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:19.958993 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-bf4f3ef9-8e62-4125-848b-afdfdccfbc97 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c" status: 200 len: 1514 microversion: 2.1 time: 0.152490 Jan 19 13:15:19.959547 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 633/1271] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:19 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:15:20.976359 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3b20698e-caa2-4c83-8d39-fef04373f63e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:20.977068 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3b20698e-caa2-4c83-8d39-fef04373f63e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:20.983331 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b20698e-caa2-4c83-8d39-fef04373f63e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:20.983787 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b20698e-caa2-4c83-8d39-fef04373f63e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:20.984598 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b20698e-caa2-4c83-8d39-fef04373f63e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:20.985040 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3b20698e-caa2-4c83-8d39-fef04373f63e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:21.111095 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3b20698e-caa2-4c83-8d39-fef04373f63e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:21.118599 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3b20698e-caa2-4c83-8d39-fef04373f63e tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c" status: 200 len: 1514 microversion: 2.1 time: 0.146842 Jan 19 13:15:21.119107 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 639/1272] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:20 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:15:22.135777 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6079dcd9-23ab-4437-90d7-251181244e34 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:22.136644 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6079dcd9-23ab-4437-90d7-251181244e34 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:22.143535 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6079dcd9-23ab-4437-90d7-251181244e34 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:22.144010 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6079dcd9-23ab-4437-90d7-251181244e34 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:22.144825 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6079dcd9-23ab-4437-90d7-251181244e34 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:22.145267 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6079dcd9-23ab-4437-90d7-251181244e34 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:22.379855 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6079dcd9-23ab-4437-90d7-251181244e34 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:22.389773 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6079dcd9-23ab-4437-90d7-251181244e34 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c" status: 200 len: 1514 microversion: 2.1 time: 0.258598 Jan 19 13:15:22.391479 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-4df28c75-0dca-486d-824f-be2f2aa2994b req-25220e80-31f7-46d2-b6e8-68ade9040ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ab993a-e1be-450c-99c7-637403460d5c", "name": "network-vif-deleted", "tag": "5f8ad3b5-4989-4feb-9282-62aa8f765152"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:15:22.393211 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:15:22.393211 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:15:22.400270 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 634/1273] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:22 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:15:22.401121 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-4df28c75-0dca-486d-824f-be2f2aa2994b req-25220e80-31f7-46d2-b6e8-68ade9040ce1 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:22.401726 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-4df28c75-0dca-486d-824f-be2f2aa2994b req-25220e80-31f7-46d2-b6e8-68ade9040ce1 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:22.413675 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-4df28c75-0dca-486d-824f-be2f2aa2994b req-25220e80-31f7-46d2-b6e8-68ade9040ce1 service nova] Creating event network-vif-deleted:5f8ad3b5-4989-4feb-9282-62aa8f765152 for instance b4ab993a-e1be-450c-99c7-637403460d5c on hv-cinder-82301 Jan 19 13:15:22.419614 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-4df28c75-0dca-486d-824f-be2f2aa2994b req-25220e80-31f7-46d2-b6e8-68ade9040ce1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031633 Jan 19 13:15:22.420315 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 640/1274] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:15:23.406785 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c9227ea5-812d-479b-b508-5c77a395704c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:23.407397 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c9227ea5-812d-479b-b508-5c77a395704c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b4ab993a-e1be-450c-99c7-637403460d5c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:23.414274 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c9227ea5-812d-479b-b508-5c77a395704c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:23.414721 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c9227ea5-812d-479b-b508-5c77a395704c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:23.415545 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c9227ea5-812d-479b-b508-5c77a395704c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:23.416007 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c9227ea5-812d-479b-b508-5c77a395704c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:23.429439 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-c9227ea5-812d-479b-b508-5c77a395704c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] HTTP exception thrown: Instance b4ab993a-e1be-450c-99c7-637403460d5c could not be found. Jan 19 13:15:23.430029 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c9227ea5-812d-479b-b508-5c77a395704c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Returning 404 to user: Instance b4ab993a-e1be-450c-99c7-637403460d5c could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:15:23.430943 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c9227ea5-812d-479b-b508-5c77a395704c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c" status: 404 len: 111 microversion: 2.1 time: 0.027918 Jan 19 13:15:23.431467 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 635/1275] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:23 2022] GET /compute/v2.1/servers/b4ab993a-e1be-450c-99c7-637403460d5c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:15:24.558891 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-fad8038a-f588-47f5-8ab2-890b671f990a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:24.559495 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-fad8038a-f588-47f5-8ab2-890b671f990a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:24.566449 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fad8038a-f588-47f5-8ab2-890b671f990a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:24.566892 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fad8038a-f588-47f5-8ab2-890b671f990a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:24.567677 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fad8038a-f588-47f5-8ab2-890b671f990a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:24.568201 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-fad8038a-f588-47f5-8ab2-890b671f990a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:24.592928 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-fad8038a-f588-47f5-8ab2-890b671f990a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Going to try to terminate instance {{(pid=116361) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:15:24.672350 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-fad8038a-f588-47f5-8ab2-890b671f990a tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133" status: 204 len: 0 microversion: 2.1 time: 0.117947 Jan 19 13:15:24.672868 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 641/1276] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:15:24 2022] DELETE /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 13:15:24.680602 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-78ab377e-9214-4419-9dcc-840f5cc252de tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:24.681204 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-78ab377e-9214-4419-9dcc-840f5cc252de tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:24.687413 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-78ab377e-9214-4419-9dcc-840f5cc252de tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:24.687857 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-78ab377e-9214-4419-9dcc-840f5cc252de tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:24.688656 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-78ab377e-9214-4419-9dcc-840f5cc252de tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:24.689088 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-78ab377e-9214-4419-9dcc-840f5cc252de tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:24.823969 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-78ab377e-9214-4419-9dcc-840f5cc252de tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:24.831384 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-78ab377e-9214-4419-9dcc-840f5cc252de tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133" status: 200 len: 1513 microversion: 2.1 time: 0.154459 Jan 19 13:15:24.831936 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 636/1277] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:24 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:15:25.849939 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f56616e6-060d-4051-8aa2-d66db1bd6be7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:25.850758 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f56616e6-060d-4051-8aa2-d66db1bd6be7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:25.857103 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f56616e6-060d-4051-8aa2-d66db1bd6be7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:25.857557 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f56616e6-060d-4051-8aa2-d66db1bd6be7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:25.858343 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f56616e6-060d-4051-8aa2-d66db1bd6be7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:25.858784 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f56616e6-060d-4051-8aa2-d66db1bd6be7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:25.993954 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f56616e6-060d-4051-8aa2-d66db1bd6be7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:26.001382 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f56616e6-060d-4051-8aa2-d66db1bd6be7 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133" status: 200 len: 1513 microversion: 2.1 time: 0.156089 Jan 19 13:15:26.001992 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 642/1278] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:25 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:15:27.027605 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2728d688-4bb9-4005-a018-ddd6dd84d666 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:27.028521 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2728d688-4bb9-4005-a018-ddd6dd84d666 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:27.035199 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2728d688-4bb9-4005-a018-ddd6dd84d666 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:27.035653 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2728d688-4bb9-4005-a018-ddd6dd84d666 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:27.036458 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2728d688-4bb9-4005-a018-ddd6dd84d666 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:27.036957 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2728d688-4bb9-4005-a018-ddd6dd84d666 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:27.227625 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2728d688-4bb9-4005-a018-ddd6dd84d666 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:27.236057 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2728d688-4bb9-4005-a018-ddd6dd84d666 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133" status: 200 len: 1513 microversion: 2.1 time: 0.220927 Jan 19 13:15:27.236629 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 637/1279] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:27 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133 => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:15:27.317692 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-e0cd12be-0c7d-4c3d-beca-b3fa4e42a726 req-bc375c90-d4e0-4653-b7da-0795034ebc26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8cfb85-c720-4bf9-b224-7787e0314133", "name": "network-vif-deleted", "tag": "771e9a17-d878-477d-b112-efecdb278d60"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:15:27.321148 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:15:27.321148 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:15:27.329900 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-e0cd12be-0c7d-4c3d-beca-b3fa4e42a726 req-bc375c90-d4e0-4653-b7da-0795034ebc26 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:27.330346 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-e0cd12be-0c7d-4c3d-beca-b3fa4e42a726 req-bc375c90-d4e0-4653-b7da-0795034ebc26 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:27.343105 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-e0cd12be-0c7d-4c3d-beca-b3fa4e42a726 req-bc375c90-d4e0-4653-b7da-0795034ebc26 service nova] Creating event network-vif-deleted:771e9a17-d878-477d-b112-efecdb278d60 for instance aa8cfb85-c720-4bf9-b224-7787e0314133 on hv-cinder-82301 Jan 19 13:15:27.347761 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-e0cd12be-0c7d-4c3d-beca-b3fa4e42a726 req-bc375c90-d4e0-4653-b7da-0795034ebc26 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033667 Jan 19 13:15:27.348423 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 643/1280] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:15:28.253414 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-631cc2e1-c5f9-4919-96fc-9f4458524a9c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:28.254023 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-631cc2e1-c5f9-4919-96fc-9f4458524a9c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: aa8cfb85-c720-4bf9-b224-7787e0314133] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:28.261283 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-631cc2e1-c5f9-4919-96fc-9f4458524a9c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:28.261738 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-631cc2e1-c5f9-4919-96fc-9f4458524a9c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:28.262516 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-631cc2e1-c5f9-4919-96fc-9f4458524a9c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:28.262955 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-631cc2e1-c5f9-4919-96fc-9f4458524a9c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:28.276808 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-631cc2e1-c5f9-4919-96fc-9f4458524a9c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] HTTP exception thrown: Instance aa8cfb85-c720-4bf9-b224-7787e0314133 could not be found. Jan 19 13:15:28.277385 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-631cc2e1-c5f9-4919-96fc-9f4458524a9c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Returning 404 to user: Instance aa8cfb85-c720-4bf9-b224-7787e0314133 could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:15:28.278189 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-631cc2e1-c5f9-4919-96fc-9f4458524a9c tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133" status: 404 len: 111 microversion: 2.1 time: 0.028574 Jan 19 13:15:28.278711 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 638/1281] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:28 2022] GET /compute/v2.1/servers/aa8cfb85-c720-4bf9-b224-7787e0314133 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:15:28.287957 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b82edd1f-c294-409b-b7be-4de859c3fc07 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:28.288565 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b82edd1f-c294-409b-b7be-4de859c3fc07 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:28.294715 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b82edd1f-c294-409b-b7be-4de859c3fc07 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:28.295159 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b82edd1f-c294-409b-b7be-4de859c3fc07 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:28.295926 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b82edd1f-c294-409b-b7be-4de859c3fc07 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:28.296383 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b82edd1f-c294-409b-b7be-4de859c3fc07 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:28.321994 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b82edd1f-c294-409b-b7be-4de859c3fc07 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Going to try to terminate instance {{(pid=116361) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:15:28.399009 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b82edd1f-c294-409b-b7be-4de859c3fc07 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b" status: 204 len: 0 microversion: 2.1 time: 0.114709 Jan 19 13:15:28.399764 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 644/1282] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:15:28 2022] DELETE /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:15:28.407950 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3e35e8ad-9ee6-49d9-87d4-e6bf597854b4 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:28.408617 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3e35e8ad-9ee6-49d9-87d4-e6bf597854b4 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:28.414489 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3e35e8ad-9ee6-49d9-87d4-e6bf597854b4 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:28.414943 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3e35e8ad-9ee6-49d9-87d4-e6bf597854b4 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:28.415734 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3e35e8ad-9ee6-49d9-87d4-e6bf597854b4 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:28.416197 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3e35e8ad-9ee6-49d9-87d4-e6bf597854b4 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:28.553288 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-3e35e8ad-9ee6-49d9-87d4-e6bf597854b4 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:28.560714 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3e35e8ad-9ee6-49d9-87d4-e6bf597854b4 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b" status: 200 len: 1513 microversion: 2.1 time: 0.156542 Jan 19 13:15:28.561268 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 639/1283] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:28 2022] GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:15:29.579445 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9b15c7d9-77ec-4c37-a44e-0bfc6ad947e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:29.580205 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9b15c7d9-77ec-4c37-a44e-0bfc6ad947e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:29.587088 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9b15c7d9-77ec-4c37-a44e-0bfc6ad947e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:29.587543 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9b15c7d9-77ec-4c37-a44e-0bfc6ad947e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:29.588423 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9b15c7d9-77ec-4c37-a44e-0bfc6ad947e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:29.588867 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9b15c7d9-77ec-4c37-a44e-0bfc6ad947e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:29.723752 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-9b15c7d9-77ec-4c37-a44e-0bfc6ad947e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:29.731352 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9b15c7d9-77ec-4c37-a44e-0bfc6ad947e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b" status: 200 len: 1513 microversion: 2.1 time: 0.156653 Jan 19 13:15:29.731923 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 645/1284] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:29 2022] GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:15:30.749022 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5bbcd121-bb5c-44d4-b708-d59cca41a140 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:30.750278 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5bbcd121-bb5c-44d4-b708-d59cca41a140 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:30.758985 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5bbcd121-bb5c-44d4-b708-d59cca41a140 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:30.759694 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5bbcd121-bb5c-44d4-b708-d59cca41a140 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:30.760675 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5bbcd121-bb5c-44d4-b708-d59cca41a140 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:30.761110 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5bbcd121-bb5c-44d4-b708-d59cca41a140 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:30.784124 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-b3844704-1bc1-457c-9e95-1dd0a1b8dc90 req-6a3227b7-a9ae-405e-aa08-6cc78e187c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f888fb9-a7aa-49fe-a65a-d88552b69b0b", "name": "network-vif-deleted", "tag": "59c5b9d4-f569-4a17-981a-bf4fe9a03bbb"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:15:30.786036 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:15:30.786036 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:15:30.796747 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-b3844704-1bc1-457c-9e95-1dd0a1b8dc90 req-6a3227b7-a9ae-405e-aa08-6cc78e187c3b service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:30.797741 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-b3844704-1bc1-457c-9e95-1dd0a1b8dc90 req-6a3227b7-a9ae-405e-aa08-6cc78e187c3b service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:30.812216 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-b3844704-1bc1-457c-9e95-1dd0a1b8dc90 req-6a3227b7-a9ae-405e-aa08-6cc78e187c3b service nova] Creating event network-vif-deleted:59c5b9d4-f569-4a17-981a-bf4fe9a03bbb for instance 0f888fb9-a7aa-49fe-a65a-d88552b69b0b on hv-cinder-82301 Jan 19 13:15:30.817772 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-b3844704-1bc1-457c-9e95-1dd0a1b8dc90 req-6a3227b7-a9ae-405e-aa08-6cc78e187c3b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039172 Jan 19 13:15:30.819432 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 646/1285] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:15:30.846346 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5bbcd121-bb5c-44d4-b708-d59cca41a140 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:30.855176 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5bbcd121-bb5c-44d4-b708-d59cca41a140 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b" status: 200 len: 1471 microversion: 2.1 time: 0.109732 Jan 19 13:15:30.856236 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 640/1286] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:30 2022] GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b => generated 1471 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:15:31.872906 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5c3d0d40-7406-46e0-b127-2455527b1323 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:31.873604 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5c3d0d40-7406-46e0-b127-2455527b1323 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: 0f888fb9-a7aa-49fe-a65a-d88552b69b0b] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:31.880734 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5c3d0d40-7406-46e0-b127-2455527b1323 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:31.881237 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5c3d0d40-7406-46e0-b127-2455527b1323 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:31.882055 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5c3d0d40-7406-46e0-b127-2455527b1323 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:31.882573 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5c3d0d40-7406-46e0-b127-2455527b1323 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:31.896578 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-5c3d0d40-7406-46e0-b127-2455527b1323 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] HTTP exception thrown: Instance 0f888fb9-a7aa-49fe-a65a-d88552b69b0b could not be found. Jan 19 13:15:31.897222 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5c3d0d40-7406-46e0-b127-2455527b1323 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Returning 404 to user: Instance 0f888fb9-a7aa-49fe-a65a-d88552b69b0b could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:15:31.898180 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5c3d0d40-7406-46e0-b127-2455527b1323 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b" status: 404 len: 111 microversion: 2.1 time: 0.029226 Jan 19 13:15:31.900043 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 647/1287] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:31 2022] GET /compute/v2.1/servers/0f888fb9-a7aa-49fe-a65a-d88552b69b0b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:15:33.028233 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-1f2de87d-c2c7-4062-867a-7716475c7cf1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:33.028753 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-1f2de87d-c2c7-4062-867a-7716475c7cf1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:33.034969 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1f2de87d-c2c7-4062-867a-7716475c7cf1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:33.035424 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1f2de87d-c2c7-4062-867a-7716475c7cf1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:33.036234 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1f2de87d-c2c7-4062-867a-7716475c7cf1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:33.036682 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1f2de87d-c2c7-4062-867a-7716475c7cf1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:33.061194 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-1f2de87d-c2c7-4062-867a-7716475c7cf1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Going to try to terminate instance {{(pid=116360) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:15:33.136337 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-1f2de87d-c2c7-4062-867a-7716475c7cf1 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 204 len: 0 microversion: 2.1 time: 0.111799 Jan 19 13:15:33.136906 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 641/1288] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:15:33 2022] DELETE /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:15:33.144697 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-93eec659-4248-4dea-a50f-23e8351cc8e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:33.145297 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-93eec659-4248-4dea-a50f-23e8351cc8e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:33.152155 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-93eec659-4248-4dea-a50f-23e8351cc8e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:33.152596 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-93eec659-4248-4dea-a50f-23e8351cc8e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:33.153365 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-93eec659-4248-4dea-a50f-23e8351cc8e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:33.153798 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-93eec659-4248-4dea-a50f-23e8351cc8e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:33.286667 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-93eec659-4248-4dea-a50f-23e8351cc8e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:33.294173 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-93eec659-4248-4dea-a50f-23e8351cc8e2 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 200 len: 1513 microversion: 2.1 time: 0.153067 Jan 19 13:15:33.294737 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 648/1289] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:33 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:15:34.312125 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-667fd2a1-c7e2-4199-9691-e613357d8138 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:34.312753 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-667fd2a1-c7e2-4199-9691-e613357d8138 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:34.318977 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-667fd2a1-c7e2-4199-9691-e613357d8138 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:34.319431 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-667fd2a1-c7e2-4199-9691-e613357d8138 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:34.320239 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-667fd2a1-c7e2-4199-9691-e613357d8138 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:34.320974 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-667fd2a1-c7e2-4199-9691-e613357d8138 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:34.458244 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-667fd2a1-c7e2-4199-9691-e613357d8138 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:34.466200 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-667fd2a1-c7e2-4199-9691-e613357d8138 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 200 len: 1513 microversion: 2.1 time: 0.158250 Jan 19 13:15:34.466755 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 642/1290] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:34 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:15:35.458754 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-dd0bc25b-e091-4a9d-b97a-80f812e4b9f7 req-7ada8472-77af-428f-a32c-dc2070310a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70d986e-67d9-4c1a-b4e1-0d05a727b5b6", "name": "network-vif-deleted", "tag": "9205ccaa-4015-4f7f-9495-f8d8bf8b4502"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:15:35.460517 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:15:35.460517 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:15:35.470044 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-dd0bc25b-e091-4a9d-b97a-80f812e4b9f7 req-7ada8472-77af-428f-a32c-dc2070310a9f service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:35.470488 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-dd0bc25b-e091-4a9d-b97a-80f812e4b9f7 req-7ada8472-77af-428f-a32c-dc2070310a9f service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:35.483035 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-dd0bc25b-e091-4a9d-b97a-80f812e4b9f7 req-7ada8472-77af-428f-a32c-dc2070310a9f service nova] Creating event network-vif-deleted:9205ccaa-4015-4f7f-9495-f8d8bf8b4502 for instance b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 on hv-cinder-82301 Jan 19 13:15:35.483610 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f6fe2801-cbc7-4c5a-a7c1-47d0e8fb5049 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:35.484240 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f6fe2801-cbc7-4c5a-a7c1-47d0e8fb5049 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:35.489085 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-dd0bc25b-e091-4a9d-b97a-80f812e4b9f7 req-7ada8472-77af-428f-a32c-dc2070310a9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034070 Jan 19 13:15:35.489683 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 649/1291] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:15:35.490699 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f6fe2801-cbc7-4c5a-a7c1-47d0e8fb5049 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:35.491147 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f6fe2801-cbc7-4c5a-a7c1-47d0e8fb5049 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:35.491920 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f6fe2801-cbc7-4c5a-a7c1-47d0e8fb5049 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:35.492523 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f6fe2801-cbc7-4c5a-a7c1-47d0e8fb5049 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:35.556426 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-f6fe2801-cbc7-4c5a-a7c1-47d0e8fb5049 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a910cea139a54d91b857994060c3ba42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a039c553a406a96e802aa59566f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:15:35.563899 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f6fe2801-cbc7-4c5a-a7c1-47d0e8fb5049 tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 200 len: 1302 microversion: 2.1 time: 0.084572 Jan 19 13:15:35.564585 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 643/1292] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:35 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 1302 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:15:36.581339 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2ac25bf1-ff06-467d-adfa-b83b53de98be tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:36.582115 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2ac25bf1-ff06-467d-adfa-b83b53de98be tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] [instance: b70d986e-67d9-4c1a-b4e1-0d05a727b5b6] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:15:36.588729 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ac25bf1-ff06-467d-adfa-b83b53de98be tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:36.589182 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ac25bf1-ff06-467d-adfa-b83b53de98be tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:36.589958 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ac25bf1-ff06-467d-adfa-b83b53de98be tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:36.590391 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ac25bf1-ff06-467d-adfa-b83b53de98be tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:36.604126 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-2ac25bf1-ff06-467d-adfa-b83b53de98be tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] HTTP exception thrown: Instance b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 could not be found. Jan 19 13:15:36.604703 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2ac25bf1-ff06-467d-adfa-b83b53de98be tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] Returning 404 to user: Instance b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:15:36.605503 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2ac25bf1-ff06-467d-adfa-b83b53de98be tempest-AttachVolumeNegativeTest-995416448 tempest-AttachVolumeNegativeTest-995416448-project] 10.222.0.48 "GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6" status: 404 len: 111 microversion: 2.1 time: 0.028656 Jan 19 13:15:36.606013 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 650/1293] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:15:36 2022] GET /compute/v2.1/servers/b70d986e-67d9-4c1a-b4e1-0d05a727b5b6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:15:38.311966 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-748d8b4e-9ce8-4730-89b6-e3ccde770aaf tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] Action: 'create', calling method: .version_select at 0x7f07e468cca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-690083222", "metadata": {"Type": "work"}}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:15:38.577081 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-748d8b4e-9ce8-4730-89b6-e3ccde770aaf tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.374541 Jan 19 13:15:38.578137 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 644/1294] 10.222.0.48 () {60 vars in 1155 bytes} [Wed Jan 19 13:15:38 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 376 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 19 13:15:38.594681 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c8b3a29d-11d0-4127-8824-301c457e97bc tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] Calling method '.version_select at 0x7f07d7da8f70>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:38.643094 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c8b3a29d-11d0-4127-8824-301c457e97bc tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/73bfce37-9537-4f0a-9361-968bb7d8fe15" status: 200 len: 352 microversion: 2.1 time: 0.057970 Jan 19 13:15:38.643777 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 651/1295] 10.222.0.48 () {58 vars in 1244 bytes} [Wed Jan 19 13:15:38 2022] GET /compute/v2.1/os-volumes/73bfce37-9537-4f0a-9361-968bb7d8fe15 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:15:39.655749 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e4b1d0b3-efba-4c59-82a1-b13f3352f646 tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] Calling method '.version_select at 0x7f07e462c5e0>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:39.703117 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e4b1d0b3-efba-4c59-82a1-b13f3352f646 tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/73bfce37-9537-4f0a-9361-968bb7d8fe15" status: 200 len: 352 microversion: 2.1 time: 0.051471 Jan 19 13:15:39.703749 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 645/1296] 10.222.0.48 () {58 vars in 1244 bytes} [Wed Jan 19 13:15:39 2022] GET /compute/v2.1/os-volumes/73bfce37-9537-4f0a-9361-968bb7d8fe15 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:15:40.716044 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-985ab236-00f9-4fa3-a097-323c37a2d9e5 tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] Calling method '.version_select at 0x7f07d7e079d0>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:40.761039 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-985ab236-00f9-4fa3-a097-323c37a2d9e5 tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/73bfce37-9537-4f0a-9361-968bb7d8fe15" status: 200 len: 353 microversion: 2.1 time: 0.049122 Jan 19 13:15:40.762442 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 652/1297] 10.222.0.48 () {58 vars in 1244 bytes} [Wed Jan 19 13:15:40 2022] GET /compute/v2.1/os-volumes/73bfce37-9537-4f0a-9361-968bb7d8fe15 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:15:40.773303 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-df0baf43-1cca-4a1b-a7fc-d4278e78eafe tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] Calling method '.version_select at 0x7f07e46988b0>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:40.816956 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-df0baf43-1cca-4a1b-a7fc-d4278e78eafe tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/73bfce37-9537-4f0a-9361-968bb7d8fe15" status: 200 len: 353 microversion: 2.1 time: 0.047667 Jan 19 13:15:40.817517 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 646/1298] 10.222.0.48 () {58 vars in 1244 bytes} [Wed Jan 19 13:15:40 2022] GET /compute/v2.1/os-volumes/73bfce37-9537-4f0a-9361-968bb7d8fe15 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:15:40.833530 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-bea3ae5e-8480-46eb-8fc3-648c2d620f23 tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] Calling method '.version_select at 0x7f07d7e13550>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:40.893422 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-bea3ae5e-8480-46eb-8fc3-648c2d620f23 tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/73bfce37-9537-4f0a-9361-968bb7d8fe15" status: 202 len: 0 microversion: 2.1 time: 0.063437 Jan 19 13:15:40.894009 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 653/1299] 10.222.0.48 () {58 vars in 1247 bytes} [Wed Jan 19 13:15:40 2022] DELETE /compute/v2.1/os-volumes/73bfce37-9537-4f0a-9361-968bb7d8fe15 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:15:40.901884 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f53d5c33-204e-46fd-8fc4-8b7fc08e06ca tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] Calling method '.version_select at 0x7f07e4681e50>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:40.950468 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f53d5c33-204e-46fd-8fc4-8b7fc08e06ca tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/73bfce37-9537-4f0a-9361-968bb7d8fe15" status: 200 len: 352 microversion: 2.1 time: 0.052293 Jan 19 13:15:40.951035 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 647/1300] 10.222.0.48 () {58 vars in 1244 bytes} [Wed Jan 19 13:15:40 2022] GET /compute/v2.1/os-volumes/73bfce37-9537-4f0a-9361-968bb7d8fe15 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:15:41.963362 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-84a9895b-5621-451a-be52-dc3c4741f972 tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] Calling method '.version_select at 0x7f07d7da8280>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:15:41.988482 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-84a9895b-5621-451a-be52-dc3c4741f972 tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] HTTP exception thrown: Volume 73bfce37-9537-4f0a-9361-968bb7d8fe15 could not be found. Jan 19 13:15:41.989081 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-84a9895b-5621-451a-be52-dc3c4741f972 tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] Returning 404 to user: Volume 73bfce37-9537-4f0a-9361-968bb7d8fe15 could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:15:41.989896 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-84a9895b-5621-451a-be52-dc3c4741f972 tempest-VolumesGetTestJSON-804439289 tempest-VolumesGetTestJSON-804439289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/73bfce37-9537-4f0a-9361-968bb7d8fe15" status: 404 len: 109 microversion: 2.1 time: 0.031239 Jan 19 13:15:41.990422 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 654/1301] 10.222.0.48 () {58 vars in 1244 bytes} [Wed Jan 19 13:15:41 2022] GET /compute/v2.1/os-volumes/73bfce37-9537-4f0a-9361-968bb7d8fe15 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:15:59.526576 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-327495661", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452", "networks": [{"uuid": "61f6820b-36e9-4b7c-8080-e6fab56b1c25"}]}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:15:59.577000 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.network.neutron [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] validate_networks() for [('61f6820b-36e9-4b7c-8080-e6fab56b1c25', None, None, None, None, None)] {{(pid=116360) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:15:59.950457 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Flavor limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:15:59.950822 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Image limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:15:59.951295 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Flavor pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:15:59.951735 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Image pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:15:59.952182 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:15:59.960744 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:59.961197 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:59.962329 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:15:59.962794 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:15:59.978768 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Getting quotas for project 30dd718b52cd42bb905ae66de39c0271. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:15:59.982717 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Getting quotas for user 902878ba8dfe4572aa892ba4792f8605 and project 30dd718b52cd42bb905ae66de39c0271. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:15:59.995024 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Going to run 1 instances... {{(pid=116360) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:15:59.997326 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:16:00.040826 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-62afdd84-c25d-420d-823a-541e810fb7d8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519511 Jan 19 13:16:00.041468 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 648/1302] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:15:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:16:00.051469 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-0c90c37f-f54c-4f76-bfa1-27c9f0673496 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:16:00.052657 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-0c90c37f-f54c-4f76-bfa1-27c9f0673496 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:00.108596 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-0c90c37f-f54c-4f76-bfa1-27c9f0673496 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:16:00.115177 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-0c90c37f-f54c-4f76-bfa1-27c9f0673496 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c" status: 200 len: 1218 microversion: 2.1 time: 0.067759 Jan 19 13:16:00.115762 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 655/1303] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:16:00 2022] GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:16:01.133881 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ee23c5fd-a4ef-415d-8978-8bd65fc96346 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:16:01.135238 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ee23c5fd-a4ef-415d-8978-8bd65fc96346 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:01.142987 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ee23c5fd-a4ef-415d-8978-8bd65fc96346 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:01.143679 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ee23c5fd-a4ef-415d-8978-8bd65fc96346 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:01.144687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ee23c5fd-a4ef-415d-8978-8bd65fc96346 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:01.145128 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ee23c5fd-a4ef-415d-8978-8bd65fc96346 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:01.212566 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ee23c5fd-a4ef-415d-8978-8bd65fc96346 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:16:01.221274 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ee23c5fd-a4ef-415d-8978-8bd65fc96346 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c" status: 200 len: 1276 microversion: 2.1 time: 0.092298 Jan 19 13:16:01.221856 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 649/1304] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:16:01 2022] GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:16:02.239027 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b8f96ba6-5f5c-4921-94fc-1437316029a8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:16:02.239741 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b8f96ba6-5f5c-4921-94fc-1437316029a8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:02.247306 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8f96ba6-5f5c-4921-94fc-1437316029a8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:02.247838 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8f96ba6-5f5c-4921-94fc-1437316029a8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:02.248719 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8f96ba6-5f5c-4921-94fc-1437316029a8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:02.249230 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8f96ba6-5f5c-4921-94fc-1437316029a8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:02.482208 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b8f96ba6-5f5c-4921-94fc-1437316029a8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:16:02.489937 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b8f96ba6-5f5c-4921-94fc-1437316029a8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c" status: 200 len: 1318 microversion: 2.1 time: 0.254640 Jan 19 13:16:02.490516 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 656/1305] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:16:02 2022] GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:16:02.713925 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-c7bcaeab-ea6b-4b55-b4e7-be13552deec2 req-6b2faffa-9907-4393-b839-cad0eeca714b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90351a19-a318-4434-8b70-4dea15bafc2c", "tag": "3145e6f0-0f3c-448a-b9ee-77831a60f86f"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:16:02.715635 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:16:02.715635 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:16:02.722472 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-c7bcaeab-ea6b-4b55-b4e7-be13552deec2 req-6b2faffa-9907-4393-b839-cad0eeca714b service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:02.722916 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-c7bcaeab-ea6b-4b55-b4e7-be13552deec2 req-6b2faffa-9907-4393-b839-cad0eeca714b service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:02.734114 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-c7bcaeab-ea6b-4b55-b4e7-be13552deec2 req-6b2faffa-9907-4393-b839-cad0eeca714b service nova] Creating event network-changed:3145e6f0-0f3c-448a-b9ee-77831a60f86f for instance 90351a19-a318-4434-8b70-4dea15bafc2c on hv-cinder-82301 Jan 19 13:16:02.738998 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-c7bcaeab-ea6b-4b55-b4e7-be13552deec2 req-6b2faffa-9907-4393-b839-cad0eeca714b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152477 Jan 19 13:16:02.739583 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 650/1306] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:16:03.506572 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a2f2f6bd-936f-4d06-a0bc-96ed99f809e0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:16:03.507180 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a2f2f6bd-936f-4d06-a0bc-96ed99f809e0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:03.513573 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a2f2f6bd-936f-4d06-a0bc-96ed99f809e0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:03.514032 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a2f2f6bd-936f-4d06-a0bc-96ed99f809e0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:03.514812 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a2f2f6bd-936f-4d06-a0bc-96ed99f809e0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:03.515252 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a2f2f6bd-936f-4d06-a0bc-96ed99f809e0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:03.540903 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:16:03.545379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: Wed Jan 19 13:16:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c (ip 10.222.0.48) !!! Jan 19 13:16:03.644803 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-a2f2f6bd-936f-4d06-a0bc-96ed99f809e0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:16:03.652120 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a2f2f6bd-936f-4d06-a0bc-96ed99f809e0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c" status: 200 len: 1318 microversion: 2.1 time: 0.149405 Jan 19 13:16:03.652688 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 657/1307] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:16:03 2022] GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:16:04.669730 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-fff17923-a802-448e-976b-52a2c92e68f7 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:16:04.670353 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-fff17923-a802-448e-976b-52a2c92e68f7 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:04.676502 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fff17923-a802-448e-976b-52a2c92e68f7 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:04.676948 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fff17923-a802-448e-976b-52a2c92e68f7 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:04.677719 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fff17923-a802-448e-976b-52a2c92e68f7 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:04.678158 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fff17923-a802-448e-976b-52a2c92e68f7 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:04.809946 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-fff17923-a802-448e-976b-52a2c92e68f7 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:16:04.817180 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-fff17923-a802-448e-976b-52a2c92e68f7 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c" status: 200 len: 1318 microversion: 2.1 time: 0.152197 Jan 19 13:16:04.817722 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 651/1308] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:16:04 2022] GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:16:05.833773 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a3c64fc3-9f3f-499f-bf5a-56601379528e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:16:05.834379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a3c64fc3-9f3f-499f-bf5a-56601379528e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:05.840960 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a3c64fc3-9f3f-499f-bf5a-56601379528e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:05.841411 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a3c64fc3-9f3f-499f-bf5a-56601379528e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:05.842191 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a3c64fc3-9f3f-499f-bf5a-56601379528e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:05.842629 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a3c64fc3-9f3f-499f-bf5a-56601379528e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:05.976241 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-a3c64fc3-9f3f-499f-bf5a-56601379528e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:16:05.984596 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a3c64fc3-9f3f-499f-bf5a-56601379528e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c" status: 200 len: 1318 microversion: 2.1 time: 0.154518 Jan 19 13:16:05.985157 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 658/1309] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:16:05 2022] GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:16:07.001991 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ce8f98de-b06b-43ef-970d-75ace622a1ed tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:16:07.002591 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ce8f98de-b06b-43ef-970d-75ace622a1ed tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:07.009638 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ce8f98de-b06b-43ef-970d-75ace622a1ed tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:07.010128 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ce8f98de-b06b-43ef-970d-75ace622a1ed tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:07.010944 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ce8f98de-b06b-43ef-970d-75ace622a1ed tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:07.011381 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ce8f98de-b06b-43ef-970d-75ace622a1ed tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:07.145479 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ce8f98de-b06b-43ef-970d-75ace622a1ed tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:16:07.152798 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ce8f98de-b06b-43ef-970d-75ace622a1ed tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c" status: 200 len: 1318 microversion: 2.1 time: 0.154478 Jan 19 13:16:07.153356 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 652/1310] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:16:06 2022] GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:16:08.170185 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-68e29d4e-c0e2-4878-b6ef-04b821036d7b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:16:08.170744 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-68e29d4e-c0e2-4878-b6ef-04b821036d7b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:08.179062 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-68e29d4e-c0e2-4878-b6ef-04b821036d7b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:08.179598 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-68e29d4e-c0e2-4878-b6ef-04b821036d7b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:08.180465 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-68e29d4e-c0e2-4878-b6ef-04b821036d7b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:08.181589 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-68e29d4e-c0e2-4878-b6ef-04b821036d7b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:08.316740 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-68e29d4e-c0e2-4878-b6ef-04b821036d7b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:16:08.324334 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-68e29d4e-c0e2-4878-b6ef-04b821036d7b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c" status: 200 len: 1318 microversion: 2.1 time: 0.158210 Jan 19 13:16:08.324915 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 659/1311] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:16:08 2022] GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:16:08.484160 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-59f7219d-8c12-446a-8405-76b20980aa06 req-7b011295-0df5-4c51-9fba-54b47b1946e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90351a19-a318-4434-8b70-4dea15bafc2c", "name": "network-vif-plugged", "status": "completed", "tag": "3145e6f0-0f3c-448a-b9ee-77831a60f86f"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:16:08.485698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:16:08.485698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:16:08.493893 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-59f7219d-8c12-446a-8405-76b20980aa06 req-7b011295-0df5-4c51-9fba-54b47b1946e3 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:08.494635 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-59f7219d-8c12-446a-8405-76b20980aa06 req-7b011295-0df5-4c51-9fba-54b47b1946e3 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:08.504889 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-59f7219d-8c12-446a-8405-76b20980aa06 req-7b011295-0df5-4c51-9fba-54b47b1946e3 service nova] Creating event network-vif-plugged:3145e6f0-0f3c-448a-b9ee-77831a60f86f for instance 90351a19-a318-4434-8b70-4dea15bafc2c on hv-cinder-82301 Jan 19 13:16:08.510261 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-59f7219d-8c12-446a-8405-76b20980aa06 req-7b011295-0df5-4c51-9fba-54b47b1946e3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085985 Jan 19 13:16:08.510834 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 653/1312] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:16:09.341603 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4f19784c-298f-420a-abb9-6a114c783a2d tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:16:09.342211 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4f19784c-298f-420a-abb9-6a114c783a2d tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:09.348430 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f19784c-298f-420a-abb9-6a114c783a2d tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:09.348874 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f19784c-298f-420a-abb9-6a114c783a2d tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:09.349667 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f19784c-298f-420a-abb9-6a114c783a2d tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:09.350101 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4f19784c-298f-420a-abb9-6a114c783a2d tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:09.482814 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4f19784c-298f-420a-abb9-6a114c783a2d tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:16:09.490164 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4f19784c-298f-420a-abb9-6a114c783a2d tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c" status: 200 len: 1318 microversion: 2.1 time: 0.152807 Jan 19 13:16:09.490789 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 660/1313] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:16:09 2022] GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:16:10.508452 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-fc1d62de-9406-46e8-9dab-f45801f6709b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:16:10.509141 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-fc1d62de-9406-46e8-9dab-f45801f6709b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:10.516637 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fc1d62de-9406-46e8-9dab-f45801f6709b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:10.517083 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fc1d62de-9406-46e8-9dab-f45801f6709b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:10.517851 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fc1d62de-9406-46e8-9dab-f45801f6709b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:10.518285 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-fc1d62de-9406-46e8-9dab-f45801f6709b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:10.647663 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-fc1d62de-9406-46e8-9dab-f45801f6709b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:16:10.655698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-fc1d62de-9406-46e8-9dab-f45801f6709b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c" status: 200 len: 1507 microversion: 2.1 time: 0.151445 Jan 19 13:16:10.656233 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 654/1314] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:16:10 2022] GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:16:29.880788 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-957067e2-531f-44e3-8031-73a8ea063420 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "504a48d2-a601-4163-a50e-2dda9321266e", "device": "/dev/sdb"}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:16:29.882432 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-957067e2-531f-44e3-8031-73a8ea063420 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:29.888829 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-957067e2-531f-44e3-8031-73a8ea063420 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:29.889226 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-957067e2-531f-44e3-8031-73a8ea063420 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:29.889998 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-957067e2-531f-44e3-8031-73a8ea063420 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:29.890434 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-957067e2-531f-44e3-8031-73a8ea063420 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:30.115937 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-957067e2-531f-44e3-8031-73a8ea063420 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "POST /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239400 Jan 19 13:16:30.118637 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 661/1315] 10.222.0.48 () {60 vars in 1322 bytes} [Wed Jan 19 13:16:29 2022] POST /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:16:55.694616 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-0c1194bb-0341-4b94-8f36-691ed34d40c2 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:16:55.695127 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-0c1194bb-0341-4b94-8f36-691ed34d40c2 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:55.701688 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0c1194bb-0341-4b94-8f36-691ed34d40c2 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:55.702136 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0c1194bb-0341-4b94-8f36-691ed34d40c2 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:55.702908 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0c1194bb-0341-4b94-8f36-691ed34d40c2 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:55.703583 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-0c1194bb-0341-4b94-8f36-691ed34d40c2 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:55.784671 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.objects.instance [None req-0c1194bb-0341-4b94-8f36-691ed34d40c2 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lazy-loading 'services' on Instance uuid 90351a19-a318-4434-8b70-4dea15bafc2c {{(pid=116360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:16:55.851496 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-0c1194bb-0341-4b94-8f36-691ed34d40c2 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "DELETE /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c/os-volume_attachments/504a48d2-a601-4163-a50e-2dda9321266e" status: 202 len: 0 microversion: 2.1 time: 0.160971 Jan 19 13:16:55.852148 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 655/1316] 10.222.0.48 () {58 vars in 1415 bytes} [Wed Jan 19 13:16:55 2022] DELETE /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c/os-volume_attachments/504a48d2-a601-4163-a50e-2dda9321266e => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:16:56.960986 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-9fe5e3ec-27f8-4d0b-8000-73806d77388b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:16:56.961570 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9fe5e3ec-27f8-4d0b-8000-73806d77388b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:56.968086 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9fe5e3ec-27f8-4d0b-8000-73806d77388b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:56.968538 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9fe5e3ec-27f8-4d0b-8000-73806d77388b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:56.969313 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9fe5e3ec-27f8-4d0b-8000-73806d77388b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:56.969742 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-9fe5e3ec-27f8-4d0b-8000-73806d77388b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:56.993713 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-9fe5e3ec-27f8-4d0b-8000-73806d77388b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Going to try to terminate instance {{(pid=116361) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:16:57.065632 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-9fe5e3ec-27f8-4d0b-8000-73806d77388b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "DELETE /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c" status: 204 len: 0 microversion: 2.1 time: 0.108921 Jan 19 13:16:57.066360 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 662/1317] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:16:56 2022] DELETE /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:16:57.077201 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-4b0dc04b-1b6f-4a53-b0e4-5bbbf9fe67bf tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:16:57.078014 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-4b0dc04b-1b6f-4a53-b0e4-5bbbf9fe67bf tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:57.084787 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4b0dc04b-1b6f-4a53-b0e4-5bbbf9fe67bf tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:57.085245 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4b0dc04b-1b6f-4a53-b0e4-5bbbf9fe67bf tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:57.086024 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4b0dc04b-1b6f-4a53-b0e4-5bbbf9fe67bf tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:57.086466 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-4b0dc04b-1b6f-4a53-b0e4-5bbbf9fe67bf tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:57.225278 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-4b0dc04b-1b6f-4a53-b0e4-5bbbf9fe67bf tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:16:57.232573 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-4b0dc04b-1b6f-4a53-b0e4-5bbbf9fe67bf tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c" status: 200 len: 1513 microversion: 2.1 time: 0.160079 Jan 19 13:16:57.233135 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 656/1318] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:16:57 2022] GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:16:58.250166 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-7a5dcfd0-2add-48c3-a516-a997ee283274 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:16:58.250779 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-7a5dcfd0-2add-48c3-a516-a997ee283274 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:58.258053 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7a5dcfd0-2add-48c3-a516-a997ee283274 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:58.258508 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7a5dcfd0-2add-48c3-a516-a997ee283274 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:58.259285 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7a5dcfd0-2add-48c3-a516-a997ee283274 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:58.259720 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-7a5dcfd0-2add-48c3-a516-a997ee283274 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:58.388220 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-7a5dcfd0-2add-48c3-a516-a997ee283274 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:16:58.395633 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-7a5dcfd0-2add-48c3-a516-a997ee283274 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c" status: 200 len: 1513 microversion: 2.1 time: 0.149636 Jan 19 13:16:58.396264 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 663/1319] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:16:58 2022] GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:16:59.282659 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-18d79aef-485e-4564-9797-d2608a0c5ac8 req-4455e92e-ab47-42e8-a31f-00f9b54f88b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90351a19-a318-4434-8b70-4dea15bafc2c", "name": "network-vif-deleted", "tag": "3145e6f0-0f3c-448a-b9ee-77831a60f86f"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:16:59.284336 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:16:59.284336 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:16:59.294989 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-18d79aef-485e-4564-9797-d2608a0c5ac8 req-4455e92e-ab47-42e8-a31f-00f9b54f88b5 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:59.295458 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-18d79aef-485e-4564-9797-d2608a0c5ac8 req-4455e92e-ab47-42e8-a31f-00f9b54f88b5 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:59.308594 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-18d79aef-485e-4564-9797-d2608a0c5ac8 req-4455e92e-ab47-42e8-a31f-00f9b54f88b5 service nova] Creating event network-vif-deleted:3145e6f0-0f3c-448a-b9ee-77831a60f86f for instance 90351a19-a318-4434-8b70-4dea15bafc2c on hv-cinder-82301 Jan 19 13:16:59.313473 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-18d79aef-485e-4564-9797-d2608a0c5ac8 req-4455e92e-ab47-42e8-a31f-00f9b54f88b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034439 Jan 19 13:16:59.314263 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 657/1320] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:16:59.412679 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-54863604-ff1d-4ba6-bf55-e6cab1b3be85 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:16:59.413290 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-54863604-ff1d-4ba6-bf55-e6cab1b3be85 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:16:59.420244 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54863604-ff1d-4ba6-bf55-e6cab1b3be85 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:59.420694 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54863604-ff1d-4ba6-bf55-e6cab1b3be85 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:59.421497 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54863604-ff1d-4ba6-bf55-e6cab1b3be85 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:59.421935 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54863604-ff1d-4ba6-bf55-e6cab1b3be85 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:59.452137 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54863604-ff1d-4ba6-bf55-e6cab1b3be85 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:16:59.452515 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54863604-ff1d-4ba6-bf55-e6cab1b3be85 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:16:59.452954 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.objects.instance [None req-54863604-ff1d-4ba6-bf55-e6cab1b3be85 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lazy-loading 'fault' on Instance uuid 90351a19-a318-4434-8b70-4dea15bafc2c {{(pid=116361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:16:59.494215 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-54863604-ff1d-4ba6-bf55-e6cab1b3be85 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:16:59.501410 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-54863604-ff1d-4ba6-bf55-e6cab1b3be85 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c" status: 200 len: 1308 microversion: 2.1 time: 0.093066 Jan 19 13:16:59.501958 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 664/1321] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:16:59 2022] GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:17:00.518592 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-950c4c54-e3ba-44c4-ab51-b8ba4b3c27d0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:00.519278 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-950c4c54-e3ba-44c4-ab51-b8ba4b3c27d0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 90351a19-a318-4434-8b70-4dea15bafc2c] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:00.526007 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-950c4c54-e3ba-44c4-ab51-b8ba4b3c27d0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:00.526457 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-950c4c54-e3ba-44c4-ab51-b8ba4b3c27d0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:00.527222 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-950c4c54-e3ba-44c4-ab51-b8ba4b3c27d0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:00.527656 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-950c4c54-e3ba-44c4-ab51-b8ba4b3c27d0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:00.541127 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-950c4c54-e3ba-44c4-ab51-b8ba4b3c27d0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] HTTP exception thrown: Instance 90351a19-a318-4434-8b70-4dea15bafc2c could not be found. Jan 19 13:17:00.541718 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-950c4c54-e3ba-44c4-ab51-b8ba4b3c27d0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Returning 404 to user: Instance 90351a19-a318-4434-8b70-4dea15bafc2c could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:17:00.542538 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-950c4c54-e3ba-44c4-ab51-b8ba4b3c27d0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c" status: 404 len: 111 microversion: 2.1 time: 0.027954 Jan 19 13:17:00.543070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 658/1322] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:17:00 2022] GET /compute/v2.1/servers/90351a19-a318-4434-8b70-4dea15bafc2c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:17:10.319627 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-226600138", "imageRef": "fe07feca-da71-4da1-8761-e2552e9993aa", "flavorRef": "452", "networks": [{"uuid": "61f6820b-36e9-4b7c-8080-e6fab56b1c25"}]}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:17:10.369763 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.network.neutron [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] validate_networks() for [('61f6820b-36e9-4b7c-8080-e6fab56b1c25', None, None, None, None, None)] {{(pid=116361) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:17:10.796543 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Flavor limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:17:10.796961 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Image limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:17:10.797427 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Flavor pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:17:10.797853 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Image pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:17:10.798256 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:17:10.807375 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:10.807815 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:10.808649 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:10.809083 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:10.824874 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Getting quotas for project 30dd718b52cd42bb905ae66de39c0271. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:17:10.828696 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Getting quotas for user 902878ba8dfe4572aa892ba4792f8605 and project 30dd718b52cd42bb905ae66de39c0271. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:17:10.840092 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Going to run 1 instances... {{(pid=116361) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:17:10.842326 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe07feca-da71-4da1-8761-e2552e9993aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:17:10.885925 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c8f5a15c-d052-4965-a302-3d770a55690e tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569868 Jan 19 13:17:10.886564 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 665/1323] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:17:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:17:10.896563 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-a62b2df6-d957-49bf-a777-8201b18655e8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:10.897143 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-a62b2df6-d957-49bf-a777-8201b18655e8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:10.949638 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-a62b2df6-d957-49bf-a777-8201b18655e8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:17:10.956181 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-a62b2df6-d957-49bf-a777-8201b18655e8 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7" status: 200 len: 1218 microversion: 2.1 time: 0.063723 Jan 19 13:17:10.956745 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 659/1324] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:17:10 2022] GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:17:11.973863 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4d3f3e4d-ebda-4124-a1e9-d34dd3503c2c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:11.974615 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4d3f3e4d-ebda-4124-a1e9-d34dd3503c2c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:11.981333 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4d3f3e4d-ebda-4124-a1e9-d34dd3503c2c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:11.981789 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4d3f3e4d-ebda-4124-a1e9-d34dd3503c2c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:11.982574 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4d3f3e4d-ebda-4124-a1e9-d34dd3503c2c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:11.983015 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4d3f3e4d-ebda-4124-a1e9-d34dd3503c2c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:12.071315 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4d3f3e4d-ebda-4124-a1e9-d34dd3503c2c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:17:12.078551 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4d3f3e4d-ebda-4124-a1e9-d34dd3503c2c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7" status: 200 len: 1276 microversion: 2.1 time: 0.108904 Jan 19 13:17:12.079121 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 666/1325] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:17:11 2022] GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 => generated 1276 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:17:13.017280 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-88037f70-bb02-44d9-be5a-a582d1602eec req-8433dc24-9b53-4ebe-aba8-54ab6e40dd18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d39b40-12a4-419d-84e9-4bc5c9a1c9c7", "tag": "045693d8-5dd9-4b76-a616-d12a05819e88"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:17:13.018862 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:17:13.018862 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:17:13.028297 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-88037f70-bb02-44d9-be5a-a582d1602eec req-8433dc24-9b53-4ebe-aba8-54ab6e40dd18 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:13.028744 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-88037f70-bb02-44d9-be5a-a582d1602eec req-8433dc24-9b53-4ebe-aba8-54ab6e40dd18 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:13.039895 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-88037f70-bb02-44d9-be5a-a582d1602eec req-8433dc24-9b53-4ebe-aba8-54ab6e40dd18 service nova] Creating event network-changed:045693d8-5dd9-4b76-a616-d12a05819e88 for instance 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 on hv-cinder-82301 Jan 19 13:17:13.045006 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-88037f70-bb02-44d9-be5a-a582d1602eec req-8433dc24-9b53-4ebe-aba8-54ab6e40dd18 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031344 Jan 19 13:17:13.046061 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 660/1326] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:17:13.096229 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e19ffe20-ad67-485f-86c7-b5d8cb49edfc tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:13.096837 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e19ffe20-ad67-485f-86c7-b5d8cb49edfc tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:13.104616 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e19ffe20-ad67-485f-86c7-b5d8cb49edfc tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:13.105062 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e19ffe20-ad67-485f-86c7-b5d8cb49edfc tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:13.105835 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e19ffe20-ad67-485f-86c7-b5d8cb49edfc tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:13.106270 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e19ffe20-ad67-485f-86c7-b5d8cb49edfc tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:13.344886 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e19ffe20-ad67-485f-86c7-b5d8cb49edfc tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:17:13.352979 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e19ffe20-ad67-485f-86c7-b5d8cb49edfc tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7" status: 200 len: 1318 microversion: 2.1 time: 0.260448 Jan 19 13:17:13.353557 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 667/1327] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:17:13 2022] GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:17:14.370631 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ab31dc1b-3da3-4acf-8113-2186d34a9bec tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:14.371329 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ab31dc1b-3da3-4acf-8113-2186d34a9bec tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:14.378974 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab31dc1b-3da3-4acf-8113-2186d34a9bec tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:14.379420 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab31dc1b-3da3-4acf-8113-2186d34a9bec tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:14.380961 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab31dc1b-3da3-4acf-8113-2186d34a9bec tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:14.381398 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ab31dc1b-3da3-4acf-8113-2186d34a9bec tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:14.510065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ab31dc1b-3da3-4acf-8113-2186d34a9bec tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:17:14.517209 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ab31dc1b-3da3-4acf-8113-2186d34a9bec tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7" status: 200 len: 1318 microversion: 2.1 time: 0.151129 Jan 19 13:17:14.517765 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 661/1328] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:17:14 2022] GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:17:15.534198 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d21e9164-f6d4-4aa4-8f08-cdaa9228a90a tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:15.534781 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d21e9164-f6d4-4aa4-8f08-cdaa9228a90a tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:15.541161 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d21e9164-f6d4-4aa4-8f08-cdaa9228a90a tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:15.541608 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d21e9164-f6d4-4aa4-8f08-cdaa9228a90a tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:15.542377 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d21e9164-f6d4-4aa4-8f08-cdaa9228a90a tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:15.542808 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d21e9164-f6d4-4aa4-8f08-cdaa9228a90a tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:15.669679 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d21e9164-f6d4-4aa4-8f08-cdaa9228a90a tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:17:15.677992 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d21e9164-f6d4-4aa4-8f08-cdaa9228a90a tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7" status: 200 len: 1318 microversion: 2.1 time: 0.146322 Jan 19 13:17:15.678555 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 668/1329] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:17:15 2022] GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:17:16.695100 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e066efc1-f455-4bfc-abdb-4c2573c1b26b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:16.695644 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e066efc1-f455-4bfc-abdb-4c2573c1b26b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:16.701978 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e066efc1-f455-4bfc-abdb-4c2573c1b26b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:16.702435 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e066efc1-f455-4bfc-abdb-4c2573c1b26b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:16.703225 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e066efc1-f455-4bfc-abdb-4c2573c1b26b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:16.703668 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e066efc1-f455-4bfc-abdb-4c2573c1b26b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:16.838761 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-e066efc1-f455-4bfc-abdb-4c2573c1b26b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:17:16.846082 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e066efc1-f455-4bfc-abdb-4c2573c1b26b tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7" status: 200 len: 1318 microversion: 2.1 time: 0.155330 Jan 19 13:17:16.846652 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 662/1330] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:17:16 2022] GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:17:17.863296 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-b8699c8d-7404-45db-a54b-19ddabcc57da tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:17.863906 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-b8699c8d-7404-45db-a54b-19ddabcc57da tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:17.870587 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8699c8d-7404-45db-a54b-19ddabcc57da tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:17.871043 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8699c8d-7404-45db-a54b-19ddabcc57da tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:17.871852 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8699c8d-7404-45db-a54b-19ddabcc57da tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:17.872319 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-b8699c8d-7404-45db-a54b-19ddabcc57da tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:18.000126 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-b8699c8d-7404-45db-a54b-19ddabcc57da tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:17:18.007710 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-b8699c8d-7404-45db-a54b-19ddabcc57da tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7" status: 200 len: 1318 microversion: 2.1 time: 0.148121 Jan 19 13:17:18.008306 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 669/1331] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:17:17 2022] GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:17:18.922549 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-72cac56c-3802-4a59-bfb9-cfb6500b6a22 req-e32371ec-0b1a-47d9-82ed-847476eb7d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d39b40-12a4-419d-84e9-4bc5c9a1c9c7", "name": "network-vif-plugged", "status": "completed", "tag": "045693d8-5dd9-4b76-a616-d12a05819e88"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:17:18.924139 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:17:18.924139 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:17:18.932134 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-72cac56c-3802-4a59-bfb9-cfb6500b6a22 req-e32371ec-0b1a-47d9-82ed-847476eb7d11 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:18.932580 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-72cac56c-3802-4a59-bfb9-cfb6500b6a22 req-e32371ec-0b1a-47d9-82ed-847476eb7d11 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:18.944084 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-72cac56c-3802-4a59-bfb9-cfb6500b6a22 req-e32371ec-0b1a-47d9-82ed-847476eb7d11 service nova] Creating event network-vif-plugged:045693d8-5dd9-4b76-a616-d12a05819e88 for instance 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 on hv-cinder-82301 Jan 19 13:17:18.948863 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-72cac56c-3802-4a59-bfb9-cfb6500b6a22 req-e32371ec-0b1a-47d9-82ed-847476eb7d11 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030999 Jan 19 13:17:18.949487 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 663/1332] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:17:19.024880 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3c6431f4-8460-45b2-a7d9-ab9cae5afdc1 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:19.025552 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3c6431f4-8460-45b2-a7d9-ab9cae5afdc1 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:19.031598 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3c6431f4-8460-45b2-a7d9-ab9cae5afdc1 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:19.032079 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3c6431f4-8460-45b2-a7d9-ab9cae5afdc1 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:19.033069 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3c6431f4-8460-45b2-a7d9-ab9cae5afdc1 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:19.033301 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3c6431f4-8460-45b2-a7d9-ab9cae5afdc1 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:19.216357 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3c6431f4-8460-45b2-a7d9-ab9cae5afdc1 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:17:19.223525 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3c6431f4-8460-45b2-a7d9-ab9cae5afdc1 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7" status: 200 len: 1318 microversion: 2.1 time: 0.203053 Jan 19 13:17:19.224239 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 670/1333] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:17:19 2022] GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:17:20.241127 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-401125c8-eb05-4fdd-88b5-aa594febb520 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:20.241744 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-401125c8-eb05-4fdd-88b5-aa594febb520 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:20.247857 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-401125c8-eb05-4fdd-88b5-aa594febb520 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:20.248334 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-401125c8-eb05-4fdd-88b5-aa594febb520 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:20.249106 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-401125c8-eb05-4fdd-88b5-aa594febb520 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:20.249542 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-401125c8-eb05-4fdd-88b5-aa594febb520 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:20.381345 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-401125c8-eb05-4fdd-88b5-aa594febb520 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:17:20.388552 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-401125c8-eb05-4fdd-88b5-aa594febb520 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7" status: 200 len: 1318 microversion: 2.1 time: 0.152016 Jan 19 13:17:20.389112 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 664/1334] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:17:20 2022] GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:17:21.405756 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-67d4a7f0-f64f-4d05-b00f-65dc2b26a051 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:21.406396 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-67d4a7f0-f64f-4d05-b00f-65dc2b26a051 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:21.413513 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-67d4a7f0-f64f-4d05-b00f-65dc2b26a051 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:21.413963 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-67d4a7f0-f64f-4d05-b00f-65dc2b26a051 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:21.414751 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-67d4a7f0-f64f-4d05-b00f-65dc2b26a051 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:21.415192 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-67d4a7f0-f64f-4d05-b00f-65dc2b26a051 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:21.544310 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-67d4a7f0-f64f-4d05-b00f-65dc2b26a051 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:17:21.552164 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-67d4a7f0-f64f-4d05-b00f-65dc2b26a051 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7" status: 200 len: 1508 microversion: 2.1 time: 0.149522 Jan 19 13:17:21.552682 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 671/1335] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:17:21 2022] GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:17:21.569337 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-84755914-fbed-4512-9938-949917d60ce0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d97eead7-5c43-4a70-b5ec-d617417cdc72", "device": "/dev/sdb"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:17:21.570930 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-84755914-fbed-4512-9938-949917d60ce0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:21.577166 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-84755914-fbed-4512-9938-949917d60ce0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:21.577617 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-84755914-fbed-4512-9938-949917d60ce0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:21.578390 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-84755914-fbed-4512-9938-949917d60ce0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:21.578827 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-84755914-fbed-4512-9938-949917d60ce0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:21.800218 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-84755914-fbed-4512-9938-949917d60ce0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "POST /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.234903 Jan 19 13:17:21.800770 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 665/1336] 10.222.0.48 () {60 vars in 1322 bytes} [Wed Jan 19 13:17:21 2022] POST /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7/os-volume_attachments => generated 194 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:17:42.051780 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-319e97f7-f9e7-49c7-9952-40145e284ff0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:42.052294 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-319e97f7-f9e7-49c7-9952-40145e284ff0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:42.058243 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-319e97f7-f9e7-49c7-9952-40145e284ff0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:42.058697 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-319e97f7-f9e7-49c7-9952-40145e284ff0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:42.059481 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-319e97f7-f9e7-49c7-9952-40145e284ff0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:42.059918 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-319e97f7-f9e7-49c7-9952-40145e284ff0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:42.139170 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.objects.instance [None req-319e97f7-f9e7-49c7-9952-40145e284ff0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lazy-loading 'services' on Instance uuid 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 {{(pid=116361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:17:42.205919 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-319e97f7-f9e7-49c7-9952-40145e284ff0 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "DELETE /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7/os-volume_attachments/d97eead7-5c43-4a70-b5ec-d617417cdc72" status: 202 len: 0 microversion: 2.1 time: 0.157764 Jan 19 13:17:42.206589 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 672/1337] 10.222.0.48 () {58 vars in 1415 bytes} [Wed Jan 19 13:17:42 2022] DELETE /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7/os-volume_attachments/d97eead7-5c43-4a70-b5ec-d617417cdc72 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:17:43.312076 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-69fc226f-7d96-4424-985d-29a42bf1d91c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:43.312667 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-69fc226f-7d96-4424-985d-29a42bf1d91c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:43.319218 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-69fc226f-7d96-4424-985d-29a42bf1d91c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:43.319666 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-69fc226f-7d96-4424-985d-29a42bf1d91c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:43.320472 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-69fc226f-7d96-4424-985d-29a42bf1d91c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:43.320912 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-69fc226f-7d96-4424-985d-29a42bf1d91c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:43.345699 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-69fc226f-7d96-4424-985d-29a42bf1d91c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Going to try to terminate instance {{(pid=116360) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:17:43.419234 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-69fc226f-7d96-4424-985d-29a42bf1d91c tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "DELETE /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7" status: 204 len: 0 microversion: 2.1 time: 0.111307 Jan 19 13:17:43.420179 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 666/1338] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:17:43 2022] DELETE /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:17:43.429900 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-5f31acfa-c70b-4dfc-a0ee-975f30f31b32 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:43.430600 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-5f31acfa-c70b-4dfc-a0ee-975f30f31b32 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:43.436673 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5f31acfa-c70b-4dfc-a0ee-975f30f31b32 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:43.437127 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5f31acfa-c70b-4dfc-a0ee-975f30f31b32 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:43.437903 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5f31acfa-c70b-4dfc-a0ee-975f30f31b32 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:43.438349 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-5f31acfa-c70b-4dfc-a0ee-975f30f31b32 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:43.567231 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-5f31acfa-c70b-4dfc-a0ee-975f30f31b32 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:17:43.574514 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-5f31acfa-c70b-4dfc-a0ee-975f30f31b32 tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7" status: 200 len: 1514 microversion: 2.1 time: 0.149302 Jan 19 13:17:43.575077 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 673/1339] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:17:43 2022] GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:17:44.592511 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6ab9250c-7a91-4ab6-bcfc-ad495391087f tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:44.593219 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6ab9250c-7a91-4ab6-bcfc-ad495391087f tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:44.599591 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ab9250c-7a91-4ab6-bcfc-ad495391087f tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:44.600097 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ab9250c-7a91-4ab6-bcfc-ad495391087f tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:44.600879 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ab9250c-7a91-4ab6-bcfc-ad495391087f tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:44.601320 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6ab9250c-7a91-4ab6-bcfc-ad495391087f tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:44.733376 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6ab9250c-7a91-4ab6-bcfc-ad495391087f tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:17:44.741188 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6ab9250c-7a91-4ab6-bcfc-ad495391087f tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7" status: 200 len: 1514 microversion: 2.1 time: 0.152848 Jan 19 13:17:44.741737 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 667/1340] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:17:44 2022] GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:17:45.759088 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-dbe0fe03-5f12-488f-b93b-b8d2040c82df tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:45.759720 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-dbe0fe03-5f12-488f-b93b-b8d2040c82df tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:45.766502 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dbe0fe03-5f12-488f-b93b-b8d2040c82df tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:45.766956 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dbe0fe03-5f12-488f-b93b-b8d2040c82df tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:45.767817 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dbe0fe03-5f12-488f-b93b-b8d2040c82df tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:45.768279 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dbe0fe03-5f12-488f-b93b-b8d2040c82df tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:45.842857 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-dbe0fe03-5f12-488f-b93b-b8d2040c82df tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902878ba8dfe4572aa892ba4792f8605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dd718b52cd42bb905ae66de39c0271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:17:45.850409 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-dbe0fe03-5f12-488f-b93b-b8d2040c82df tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7" status: 200 len: 1472 microversion: 2.1 time: 0.096130 Jan 19 13:17:45.850984 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 674/1341] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:17:45 2022] GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 => generated 1472 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:17:45.875282 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-b5e37e9e-7c41-4e8b-bb76-562ebf200a46 req-039679fa-3df5-4c50-952c-8f2f2c1c714f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d39b40-12a4-419d-84e9-4bc5c9a1c9c7", "name": "network-vif-deleted", "tag": "045693d8-5dd9-4b76-a616-d12a05819e88"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:17:45.877172 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:17:45.877172 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:17:45.886883 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-b5e37e9e-7c41-4e8b-bb76-562ebf200a46 req-039679fa-3df5-4c50-952c-8f2f2c1c714f service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:45.887543 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-b5e37e9e-7c41-4e8b-bb76-562ebf200a46 req-039679fa-3df5-4c50-952c-8f2f2c1c714f service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:45.899936 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-b5e37e9e-7c41-4e8b-bb76-562ebf200a46 req-039679fa-3df5-4c50-952c-8f2f2c1c714f service nova] Creating event network-vif-deleted:045693d8-5dd9-4b76-a616-d12a05819e88 for instance 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 on hv-cinder-82301 Jan 19 13:17:45.905458 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-b5e37e9e-7c41-4e8b-bb76-562ebf200a46 req-039679fa-3df5-4c50-952c-8f2f2c1c714f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034197 Jan 19 13:17:45.906044 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 668/1342] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:17:46.391017 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:17:46.391285 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: Wed Jan 19 13:17:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:17:46.866589 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-34c32370-96f0-4fbf-a17d-b07d658c1adb tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:17:46.867194 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-34c32370-96f0-4fbf-a17d-b07d658c1adb tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] [instance: 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:17:46.873572 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-34c32370-96f0-4fbf-a17d-b07d658c1adb tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:46.874020 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-34c32370-96f0-4fbf-a17d-b07d658c1adb tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:46.874798 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-34c32370-96f0-4fbf-a17d-b07d658c1adb tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:17:46.875226 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-34c32370-96f0-4fbf-a17d-b07d658c1adb tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:17:46.888705 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-34c32370-96f0-4fbf-a17d-b07d658c1adb tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] HTTP exception thrown: Instance 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 could not be found. Jan 19 13:17:46.889283 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-34c32370-96f0-4fbf-a17d-b07d658c1adb tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] Returning 404 to user: Instance 74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:17:46.890084 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-34c32370-96f0-4fbf-a17d-b07d658c1adb tempest-VolumesSnapshotTestJSON-923686007 tempest-VolumesSnapshotTestJSON-923686007-project] 10.222.0.48 "GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7" status: 404 len: 111 microversion: 2.1 time: 0.027342 Jan 19 13:17:46.890607 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 675/1343] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:17:46 2022] GET /compute/v2.1/servers/74d39b40-12a4-419d-84e9-4bc5c9a1c9c7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:18:31.629235 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3fd05769-0e28-46aa-b96a-d2e56aa44300 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Action: 'create', calling method: .version_select at 0x7f07e42409d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-568706360"}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:18:31.644687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-3fd05769-0e28-46aa-b96a-d2e56aa44300 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Getting quotas for project 70bd5865960e4d1aa33299835fd239c0. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:18:31.649665 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-3fd05769-0e28-46aa-b96a-d2e56aa44300 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Getting quotas for user 3d7f14cf5f5642618a22aa1f59329ba1 and project 70bd5865960e4d1aa33299835fd239c0. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:18:31.773636 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-3fd05769-0e28-46aa-b96a-d2e56aa44300 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Getting quotas for project 70bd5865960e4d1aa33299835fd239c0. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:18:31.778160 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-3fd05769-0e28-46aa-b96a-d2e56aa44300 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Getting quotas for user 3d7f14cf5f5642618a22aa1f59329ba1 and project 70bd5865960e4d1aa33299835fd239c0. Resources: {'key_pairs'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:18:31.793213 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3fd05769-0e28-46aa-b96a-d2e56aa44300 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.336822 Jan 19 13:18:31.793814 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 669/1344] 10.222.0.48 () {60 vars in 1157 bytes} [Wed Jan 19 13:18:31 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:18:53.165467 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1890598661", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-568706360", "security_groups": [{"name": "tempest-secgroup-smoke-377790272"}], "block_device_mapping_v2": [{"uuid": "13ab5567-fb60-4db1-8c7b-adfd88026365", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "06087c42-5826-4410-a555-9454849c4c76"}]}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:18:53.281389 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.network.neutron [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] validate_networks() for [('06087c42-5826-4410-a555-9454849c4c76', None, None, None, None, None)] {{(pid=116361) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:18:53.661317 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Flavor limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:18:53.661736 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Image limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:18:53.662205 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Flavor pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:18:53.662607 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Image pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:18:53.663010 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:18:53.672127 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:18:53.672572 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:18:53.673369 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:18:53.673802 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:18:53.689671 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Getting quotas for project 70bd5865960e4d1aa33299835fd239c0. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:18:53.693552 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Getting quotas for user 3d7f14cf5f5642618a22aa1f59329ba1 and project 70bd5865960e4d1aa33299835fd239c0. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:18:53.747322 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Going to run 1 instances... {{(pid=116361) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:18:53.749503 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='13ab5567-fb60-4db1-8c7b-adfd88026365',volume_size=None,volume_type=None)] {{(pid=116361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:18:53.870240 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-30415fc1-b396-47c4-b28e-5080128481b3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.709087 Jan 19 13:18:53.870882 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 676/1345] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:18:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:18:53.880707 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-7315f62f-bbad-4517-a67f-4d5e4bb446a8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:18:53.881893 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-7315f62f-bbad-4517-a67f-4d5e4bb446a8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:18:53.944882 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-7315f62f-bbad-4517-a67f-4d5e4bb446a8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:18:53.952244 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-7315f62f-bbad-4517-a67f-4d5e4bb446a8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1094 microversion: 2.1 time: 0.075241 Jan 19 13:18:53.952947 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 670/1346] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:18:53 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:18:54.969963 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4e5614b8-d6e7-4b4d-933e-ff3c3748aaae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:18:54.970547 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4e5614b8-d6e7-4b4d-933e-ff3c3748aaae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:18:54.977099 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4e5614b8-d6e7-4b4d-933e-ff3c3748aaae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:18:54.977545 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4e5614b8-d6e7-4b4d-933e-ff3c3748aaae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:18:54.978326 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4e5614b8-d6e7-4b4d-933e-ff3c3748aaae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:18:54.978768 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4e5614b8-d6e7-4b4d-933e-ff3c3748aaae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:18:55.043612 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4e5614b8-d6e7-4b4d-933e-ff3c3748aaae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:18:55.050886 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4e5614b8-d6e7-4b4d-933e-ff3c3748aaae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1210 microversion: 2.1 time: 0.085235 Jan 19 13:18:55.051458 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 677/1347] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:18:54 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:18:56.068592 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-45b36e95-2fef-4125-a2e4-cddf070e7288 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:18:56.069208 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-45b36e95-2fef-4125-a2e4-cddf070e7288 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:18:56.076219 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-45b36e95-2fef-4125-a2e4-cddf070e7288 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:18:56.076672 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-45b36e95-2fef-4125-a2e4-cddf070e7288 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:18:56.077450 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-45b36e95-2fef-4125-a2e4-cddf070e7288 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:18:56.077888 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-45b36e95-2fef-4125-a2e4-cddf070e7288 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:18:56.117087 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-a48a9738-9a78-4a77-ad9e-56a62dffd033 req-05c0e5a4-01ab-49e6-acd3-9b58ed4572da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d", "tag": "288134d7-d1c8-4e7f-8258-6a996b56bd1d"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:18:56.118960 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:18:56.118960 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:18:56.129455 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-a48a9738-9a78-4a77-ad9e-56a62dffd033 req-05c0e5a4-01ab-49e6-acd3-9b58ed4572da service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:18:56.130791 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-a48a9738-9a78-4a77-ad9e-56a62dffd033 req-05c0e5a4-01ab-49e6-acd3-9b58ed4572da service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:18:56.151187 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-a48a9738-9a78-4a77-ad9e-56a62dffd033 req-05c0e5a4-01ab-49e6-acd3-9b58ed4572da service nova] Creating event network-changed:288134d7-d1c8-4e7f-8258-6a996b56bd1d for instance 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d on hv-cinder-82301 Jan 19 13:18:56.158846 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-a48a9738-9a78-4a77-ad9e-56a62dffd033 req-05c0e5a4-01ab-49e6-acd3-9b58ed4572da service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045333 Jan 19 13:18:56.160014 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 678/1348] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:18:56.268243 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-45b36e95-2fef-4125-a2e4-cddf070e7288 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:18:56.276238 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-45b36e95-2fef-4125-a2e4-cddf070e7288 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1265 microversion: 2.1 time: 0.211119 Jan 19 13:18:56.277632 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 671/1349] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:18:56 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:18:57.294802 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-27947bb6-62e3-4fb3-845e-f3279c6853ae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:18:57.295490 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-27947bb6-62e3-4fb3-845e-f3279c6853ae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:18:57.301835 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27947bb6-62e3-4fb3-845e-f3279c6853ae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:18:57.302344 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27947bb6-62e3-4fb3-845e-f3279c6853ae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:18:57.303580 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27947bb6-62e3-4fb3-845e-f3279c6853ae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:18:57.304086 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-27947bb6-62e3-4fb3-845e-f3279c6853ae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:18:57.435217 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-27947bb6-62e3-4fb3-845e-f3279c6853ae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:18:57.442536 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-27947bb6-62e3-4fb3-845e-f3279c6853ae tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1265 microversion: 2.1 time: 0.152458 Jan 19 13:18:57.443099 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 679/1350] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:18:57 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:18:58.458928 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-e5e06179-995f-4350-96c7-3dddf716c17c tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:18:58.459519 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-e5e06179-995f-4350-96c7-3dddf716c17c tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:18:58.465923 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e5e06179-995f-4350-96c7-3dddf716c17c tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:18:58.466374 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e5e06179-995f-4350-96c7-3dddf716c17c tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:18:58.467152 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e5e06179-995f-4350-96c7-3dddf716c17c tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:18:58.467591 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-e5e06179-995f-4350-96c7-3dddf716c17c tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:18:58.601297 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-e5e06179-995f-4350-96c7-3dddf716c17c tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:18:58.609366 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-e5e06179-995f-4350-96c7-3dddf716c17c tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1265 microversion: 2.1 time: 0.154130 Jan 19 13:18:58.609935 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 672/1351] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:18:58 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:18:59.626334 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-82fecef4-9fb8-4feb-be88-9466d092c8a8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:18:59.627312 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-82fecef4-9fb8-4feb-be88-9466d092c8a8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:18:59.634241 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-82fecef4-9fb8-4feb-be88-9466d092c8a8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:18:59.634691 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-82fecef4-9fb8-4feb-be88-9466d092c8a8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:18:59.635484 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-82fecef4-9fb8-4feb-be88-9466d092c8a8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:18:59.635958 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-82fecef4-9fb8-4feb-be88-9466d092c8a8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:18:59.768678 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-82fecef4-9fb8-4feb-be88-9466d092c8a8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:18:59.775847 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-82fecef4-9fb8-4feb-be88-9466d092c8a8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1265 microversion: 2.1 time: 0.153480 Jan 19 13:18:59.776428 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 680/1352] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:18:59 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:19:00.792429 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-8d8cd2ec-a191-4deb-863e-5baa06b7530d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:19:00.793080 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-8d8cd2ec-a191-4deb-863e-5baa06b7530d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:19:00.798979 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8d8cd2ec-a191-4deb-863e-5baa06b7530d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:00.799426 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8d8cd2ec-a191-4deb-863e-5baa06b7530d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:00.800217 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8d8cd2ec-a191-4deb-863e-5baa06b7530d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:00.800655 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8d8cd2ec-a191-4deb-863e-5baa06b7530d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:00.929153 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-8d8cd2ec-a191-4deb-863e-5baa06b7530d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:19:00.937134 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-8d8cd2ec-a191-4deb-863e-5baa06b7530d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1265 microversion: 2.1 time: 0.148526 Jan 19 13:19:00.937698 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 673/1353] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:19:00 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:19:01.953494 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e3467148-f393-4b16-8459-ceb3d0a50064 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:19:01.954094 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e3467148-f393-4b16-8459-ceb3d0a50064 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:19:01.960338 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3467148-f393-4b16-8459-ceb3d0a50064 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:01.960785 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3467148-f393-4b16-8459-ceb3d0a50064 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:01.961550 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3467148-f393-4b16-8459-ceb3d0a50064 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:01.961983 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e3467148-f393-4b16-8459-ceb3d0a50064 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:02.094857 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e3467148-f393-4b16-8459-ceb3d0a50064 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:19:02.102210 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e3467148-f393-4b16-8459-ceb3d0a50064 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1265 microversion: 2.1 time: 0.152374 Jan 19 13:19:02.102778 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 681/1354] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:19:01 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:19:03.118461 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-66183497-636e-4486-b055-d1eef0e7b4c8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:19:03.119002 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-66183497-636e-4486-b055-d1eef0e7b4c8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:19:03.125365 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-66183497-636e-4486-b055-d1eef0e7b4c8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:03.125809 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-66183497-636e-4486-b055-d1eef0e7b4c8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:03.126585 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-66183497-636e-4486-b055-d1eef0e7b4c8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:03.127020 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-66183497-636e-4486-b055-d1eef0e7b4c8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:03.257525 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-66183497-636e-4486-b055-d1eef0e7b4c8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:19:03.265058 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-66183497-636e-4486-b055-d1eef0e7b4c8 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1265 microversion: 2.1 time: 0.150291 Jan 19 13:19:03.265617 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 674/1355] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:19:03 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:19:04.280819 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-ed4eb5dc-5c13-464a-83a4-a8dcb0f94072 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:19:04.281420 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-ed4eb5dc-5c13-464a-83a4-a8dcb0f94072 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:19:04.287597 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed4eb5dc-5c13-464a-83a4-a8dcb0f94072 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:04.288083 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed4eb5dc-5c13-464a-83a4-a8dcb0f94072 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:04.288850 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed4eb5dc-5c13-464a-83a4-a8dcb0f94072 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:04.289276 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-ed4eb5dc-5c13-464a-83a4-a8dcb0f94072 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:04.422056 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-ed4eb5dc-5c13-464a-83a4-a8dcb0f94072 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:19:04.429399 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-ed4eb5dc-5c13-464a-83a4-a8dcb0f94072 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1265 microversion: 2.1 time: 0.152360 Jan 19 13:19:04.429959 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 682/1356] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:19:04 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:19:05.276540 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-4fd2ce41-797a-44e5-9514-0131a9675d5e req-23c13f06-8646-4fbf-bbcc-d70780ab8a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d", "name": "network-vif-plugged", "status": "completed", "tag": "288134d7-d1c8-4e7f-8258-6a996b56bd1d"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:19:05.279332 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:19:05.279332 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:19:05.287239 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-4fd2ce41-797a-44e5-9514-0131a9675d5e req-23c13f06-8646-4fbf-bbcc-d70780ab8a90 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:05.287756 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-4fd2ce41-797a-44e5-9514-0131a9675d5e req-23c13f06-8646-4fbf-bbcc-d70780ab8a90 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:05.300182 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-4fd2ce41-797a-44e5-9514-0131a9675d5e req-23c13f06-8646-4fbf-bbcc-d70780ab8a90 service nova] Creating event network-vif-plugged:288134d7-d1c8-4e7f-8258-6a996b56bd1d for instance 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d on hv-cinder-82301 Jan 19 13:19:05.306308 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-4fd2ce41-797a-44e5-9514-0131a9675d5e req-23c13f06-8646-4fbf-bbcc-d70780ab8a90 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033387 Jan 19 13:19:05.307364 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 675/1357] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:19:05.446643 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-33a98ec0-c5e0-4c38-b3e1-cbf85fbeca00 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:19:05.447207 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-33a98ec0-c5e0-4c38-b3e1-cbf85fbeca00 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:19:05.454480 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33a98ec0-c5e0-4c38-b3e1-cbf85fbeca00 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:05.454945 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33a98ec0-c5e0-4c38-b3e1-cbf85fbeca00 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:05.455735 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33a98ec0-c5e0-4c38-b3e1-cbf85fbeca00 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:05.456208 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-33a98ec0-c5e0-4c38-b3e1-cbf85fbeca00 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:05.641760 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-33a98ec0-c5e0-4c38-b3e1-cbf85fbeca00 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:19:05.653946 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-33a98ec0-c5e0-4c38-b3e1-cbf85fbeca00 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1265 microversion: 2.1 time: 0.211053 Jan 19 13:19:05.654512 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 683/1358] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:19:05 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:19:06.671229 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2f65069a-81e8-40e7-a3c1-21d2214d37d7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:19:06.671930 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2f65069a-81e8-40e7-a3c1-21d2214d37d7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:19:06.678465 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2f65069a-81e8-40e7-a3c1-21d2214d37d7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:06.678918 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2f65069a-81e8-40e7-a3c1-21d2214d37d7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:06.679690 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2f65069a-81e8-40e7-a3c1-21d2214d37d7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:06.680166 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-2f65069a-81e8-40e7-a3c1-21d2214d37d7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:06.815296 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2f65069a-81e8-40e7-a3c1-21d2214d37d7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:19:06.822594 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2f65069a-81e8-40e7-a3c1-21d2214d37d7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1265 microversion: 2.1 time: 0.155882 Jan 19 13:19:06.823149 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 676/1359] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:19:06 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:19:07.838322 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-dd2964d7-f065-4841-aab6-0b4845e0f96e tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:19:07.838930 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-dd2964d7-f065-4841-aab6-0b4845e0f96e tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:19:07.845330 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dd2964d7-f065-4841-aab6-0b4845e0f96e tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:07.845782 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dd2964d7-f065-4841-aab6-0b4845e0f96e tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:07.846553 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dd2964d7-f065-4841-aab6-0b4845e0f96e tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:07.846992 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dd2964d7-f065-4841-aab6-0b4845e0f96e tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:07.973988 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-dd2964d7-f065-4841-aab6-0b4845e0f96e tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:19:07.982046 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-dd2964d7-f065-4841-aab6-0b4845e0f96e tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1452 microversion: 2.1 time: 0.147378 Jan 19 13:19:07.982836 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 684/1360] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:19:07 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:19:07.998016 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b0624162-6ad8-4cb6-b995-e04384a3421f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:19:07.998628 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b0624162-6ad8-4cb6-b995-e04384a3421f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:19:08.004971 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b0624162-6ad8-4cb6-b995-e04384a3421f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:08.005432 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b0624162-6ad8-4cb6-b995-e04384a3421f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:08.006465 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b0624162-6ad8-4cb6-b995-e04384a3421f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:08.006909 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b0624162-6ad8-4cb6-b995-e04384a3421f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:08.138971 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b0624162-6ad8-4cb6-b995-e04384a3421f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:19:08.146270 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b0624162-6ad8-4cb6-b995-e04384a3421f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1452 microversion: 2.1 time: 0.152098 Jan 19 13:19:08.146832 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 677/1361] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:19:07 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:19:10.065100 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-201b0a64-446a-4481-9900-e68f33495fd1 req-20c1331f-cb14-4946-93af-93553bdfd38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d", "tag": "288134d7-d1c8-4e7f-8258-6a996b56bd1d"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:19:10.066645 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:19:10.066645 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:19:10.075741 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-201b0a64-446a-4481-9900-e68f33495fd1 req-20c1331f-cb14-4946-93af-93553bdfd38b service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:19:10.076215 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-201b0a64-446a-4481-9900-e68f33495fd1 req-20c1331f-cb14-4946-93af-93553bdfd38b service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:19:10.087240 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-201b0a64-446a-4481-9900-e68f33495fd1 req-20c1331f-cb14-4946-93af-93553bdfd38b service nova] Creating event network-changed:288134d7-d1c8-4e7f-8258-6a996b56bd1d for instance 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d on hv-cinder-82301 Jan 19 13:19:10.093623 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-201b0a64-446a-4481-9900-e68f33495fd1 req-20c1331f-cb14-4946-93af-93553bdfd38b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032771 Jan 19 13:19:10.094216 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 685/1362] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:19:23.553975 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:19:23.554621 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: Wed Jan 19 13:19:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:20:59.560867 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:20:59.561609 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: Wed Jan 19 13:20:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:21:06.399388 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:21:06.399954 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: Wed Jan 19 13:21:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:21:14.445996 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:21:14.446618 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: Wed Jan 19 13:21:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:21:24.107700 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-65d2e1c8-3def-4363-a72e-a3b964f3037b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:24.108429 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-65d2e1c8-3def-4363-a72e-a3b964f3037b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:24.114360 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-65d2e1c8-3def-4363-a72e-a3b964f3037b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:24.114804 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-65d2e1c8-3def-4363-a72e-a3b964f3037b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:24.115567 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-65d2e1c8-3def-4363-a72e-a3b964f3037b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:24.116018 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-65d2e1c8-3def-4363-a72e-a3b964f3037b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:24.140710 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-65d2e1c8-3def-4363-a72e-a3b964f3037b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Going to try to terminate instance {{(pid=116360) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:21:24.214571 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-65d2e1c8-3def-4363-a72e-a3b964f3037b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "DELETE /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 204 len: 0 microversion: 2.1 time: 0.111331 Jan 19 13:21:24.215210 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 678/1363] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:21:24 2022] DELETE /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:21:24.224879 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-cdd9d1c7-5df3-4c3c-be0f-4568b64a70b4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:24.225576 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-cdd9d1c7-5df3-4c3c-be0f-4568b64a70b4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:24.232290 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cdd9d1c7-5df3-4c3c-be0f-4568b64a70b4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:24.232748 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cdd9d1c7-5df3-4c3c-be0f-4568b64a70b4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:24.233532 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cdd9d1c7-5df3-4c3c-be0f-4568b64a70b4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:24.233970 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-cdd9d1c7-5df3-4c3c-be0f-4568b64a70b4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:24.437258 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-cdd9d1c7-5df3-4c3c-be0f-4568b64a70b4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:24.444636 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-cdd9d1c7-5df3-4c3c-be0f-4568b64a70b4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1577 microversion: 2.1 time: 0.224880 Jan 19 13:21:24.445195 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 686/1364] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:24 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:21:25.462994 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-6d01ce9e-39d2-434c-8e89-30bbb4201e81 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:25.463612 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-6d01ce9e-39d2-434c-8e89-30bbb4201e81 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:25.469931 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6d01ce9e-39d2-434c-8e89-30bbb4201e81 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:25.470405 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6d01ce9e-39d2-434c-8e89-30bbb4201e81 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:25.471174 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6d01ce9e-39d2-434c-8e89-30bbb4201e81 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:25.471601 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-6d01ce9e-39d2-434c-8e89-30bbb4201e81 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:25.653495 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-6d01ce9e-39d2-434c-8e89-30bbb4201e81 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:25.660783 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-6d01ce9e-39d2-434c-8e89-30bbb4201e81 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1577 microversion: 2.1 time: 0.201952 Jan 19 13:21:25.661336 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 679/1365] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:25 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1577 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:26.677090 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-856d6575-5e39-4195-a666-891036e37d85 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:26.677830 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-856d6575-5e39-4195-a666-891036e37d85 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:26.685406 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-856d6575-5e39-4195-a666-891036e37d85 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:26.686054 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-856d6575-5e39-4195-a666-891036e37d85 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:26.686986 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-856d6575-5e39-4195-a666-891036e37d85 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:26.687638 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-856d6575-5e39-4195-a666-891036e37d85 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:26.758474 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-162543de-3587-4c9c-add5-9d068e77a341 req-b5928f13-60b1-43e7-abb7-321ec4bbc871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d", "name": "network-vif-deleted", "tag": "288134d7-d1c8-4e7f-8258-6a996b56bd1d"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:21:26.760324 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:21:26.760324 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:21:26.767530 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-162543de-3587-4c9c-add5-9d068e77a341 req-b5928f13-60b1-43e7-abb7-321ec4bbc871 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:26.768040 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-162543de-3587-4c9c-add5-9d068e77a341 req-b5928f13-60b1-43e7-abb7-321ec4bbc871 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:26.779340 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-856d6575-5e39-4195-a666-891036e37d85 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:26.782841 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-162543de-3587-4c9c-add5-9d068e77a341 req-b5928f13-60b1-43e7-abb7-321ec4bbc871 service nova] Creating event network-vif-deleted:288134d7-d1c8-4e7f-8258-6a996b56bd1d for instance 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d on hv-cinder-82301 Jan 19 13:21:26.787232 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-856d6575-5e39-4195-a666-891036e37d85 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 200 len: 1510 microversion: 2.1 time: 0.114143 Jan 19 13:21:26.794054 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-162543de-3587-4c9c-add5-9d068e77a341 req-b5928f13-60b1-43e7-abb7-321ec4bbc871 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099561 Jan 19 13:21:26.795042 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 680/1366] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:21:26.796786 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 687/1367] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:26 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 1510 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:27.804335 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3a10c67a-3610-4bde-8ea4-f4b64426b8c7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:27.805037 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-3a10c67a-3610-4bde-8ea4-f4b64426b8c7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:27.812297 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3a10c67a-3610-4bde-8ea4-f4b64426b8c7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:27.812753 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3a10c67a-3610-4bde-8ea4-f4b64426b8c7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:27.813563 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3a10c67a-3610-4bde-8ea4-f4b64426b8c7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:27.814032 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-3a10c67a-3610-4bde-8ea4-f4b64426b8c7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:27.826912 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-3a10c67a-3610-4bde-8ea4-f4b64426b8c7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] HTTP exception thrown: Instance 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d could not be found. Jan 19 13:21:27.827501 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-3a10c67a-3610-4bde-8ea4-f4b64426b8c7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Returning 404 to user: Instance 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:21:27.828334 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-3a10c67a-3610-4bde-8ea4-f4b64426b8c7 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 404 len: 111 microversion: 2.1 time: 0.028068 Jan 19 13:21:27.828851 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 681/1368] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:27 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:21:27.875568 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-901703064", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-568706360", "security_groups": [{"name": "tempest-secgroup-smoke-377790272"}], "block_device_mapping_v2": [{"uuid": "13ab5567-fb60-4db1-8c7b-adfd88026365", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "06087c42-5826-4410-a555-9454849c4c76"}]}} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:21:27.986261 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.network.neutron [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] validate_networks() for [('06087c42-5826-4410-a555-9454849c4c76', None, None, None, None, None)] {{(pid=116361) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:21:28.352188 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Flavor limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:21:28.352604 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Image limits 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:21:28.353067 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Flavor pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:21:28.354064 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Image pref 0:0:0 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:21:28.354464 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.virt.hardware [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:21:28.362893 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:28.363335 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:28.364166 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:28.364596 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:28.380240 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Getting quotas for project 70bd5865960e4d1aa33299835fd239c0. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:21:28.384251 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.quota [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Getting quotas for user 3d7f14cf5f5642618a22aa1f59329ba1 and project 70bd5865960e4d1aa33299835fd239c0. Resources: {'ram', 'cores', 'instances'} {{(pid=116361) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:21:28.438503 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Going to run 1 instances... {{(pid=116361) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:21:28.440673 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='13ab5567-fb60-4db1-8c7b-adfd88026365',volume_size=None,volume_type=None)] {{(pid=116361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:21:28.559131 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e44a87a2-1c8c-4924-939b-46ef15f97859 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.687245 Jan 19 13:21:28.559764 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 688/1369] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:21:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 19 13:21:28.570678 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-2fc26ffa-861a-4801-9739-06bd9a89b669 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:28.571288 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-2fc26ffa-861a-4801-9739-06bd9a89b669 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:28.623801 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-2fc26ffa-861a-4801-9739-06bd9a89b669 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:28.631687 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-2fc26ffa-861a-4801-9739-06bd9a89b669 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1093 microversion: 2.1 time: 0.064909 Jan 19 13:21:28.632293 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 682/1370] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:28 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:29.648967 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-e0292258-4f30-4392-925e-95527dd5152b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:29.649577 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-e0292258-4f30-4392-925e-95527dd5152b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:29.656105 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e0292258-4f30-4392-925e-95527dd5152b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:29.656561 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e0292258-4f30-4392-925e-95527dd5152b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:29.657339 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e0292258-4f30-4392-925e-95527dd5152b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:29.657775 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-e0292258-4f30-4392-925e-95527dd5152b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:29.723905 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-e0292258-4f30-4392-925e-95527dd5152b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:29.732401 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-e0292258-4f30-4392-925e-95527dd5152b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1209 microversion: 2.1 time: 0.087492 Jan 19 13:21:29.742197 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 689/1371] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:29 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:30.749717 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-b54122ce-c73a-48cd-a082-80f1e0f27b64 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:30.750441 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-b54122ce-c73a-48cd-a082-80f1e0f27b64 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:30.758179 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b54122ce-c73a-48cd-a082-80f1e0f27b64 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:30.758636 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b54122ce-c73a-48cd-a082-80f1e0f27b64 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:30.759426 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b54122ce-c73a-48cd-a082-80f1e0f27b64 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:30.760433 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-b54122ce-c73a-48cd-a082-80f1e0f27b64 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:31.037162 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-b54122ce-c73a-48cd-a082-80f1e0f27b64 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:31.045074 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-b54122ce-c73a-48cd-a082-80f1e0f27b64 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1264 microversion: 2.1 time: 0.299108 Jan 19 13:21:31.045629 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 683/1372] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:30 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1264 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:31.116259 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-5b4cf281-5e3c-40ab-b4e3-82187d4fb667 req-2e0e2b16-d98a-435d-8175-c298a5b954ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a58b13b-d411-46c8-a4d4-4a319725e1d9", "tag": "0bf93f14-2a1f-46cb-bdb6-c14793e5af4b"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:21:31.118855 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:21:31.118855 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:21:31.127045 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-5b4cf281-5e3c-40ab-b4e3-82187d4fb667 req-2e0e2b16-d98a-435d-8175-c298a5b954ce service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:31.127663 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-5b4cf281-5e3c-40ab-b4e3-82187d4fb667 req-2e0e2b16-d98a-435d-8175-c298a5b954ce service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:31.139963 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-5b4cf281-5e3c-40ab-b4e3-82187d4fb667 req-2e0e2b16-d98a-435d-8175-c298a5b954ce service nova] Creating event network-changed:0bf93f14-2a1f-46cb-bdb6-c14793e5af4b for instance 4a58b13b-d411-46c8-a4d4-4a319725e1d9 on hv-cinder-82301 Jan 19 13:21:31.145167 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-5b4cf281-5e3c-40ab-b4e3-82187d4fb667 req-2e0e2b16-d98a-435d-8175-c298a5b954ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032494 Jan 19 13:21:31.146129 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 690/1373] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:21:32.061922 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-944712dd-85f6-4b33-ade9-787dbd06c8f2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:32.062445 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-944712dd-85f6-4b33-ade9-787dbd06c8f2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:32.068833 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-944712dd-85f6-4b33-ade9-787dbd06c8f2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:32.069290 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-944712dd-85f6-4b33-ade9-787dbd06c8f2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:32.070073 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-944712dd-85f6-4b33-ade9-787dbd06c8f2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:32.070516 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-944712dd-85f6-4b33-ade9-787dbd06c8f2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:32.202865 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-944712dd-85f6-4b33-ade9-787dbd06c8f2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:32.210165 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-944712dd-85f6-4b33-ade9-787dbd06c8f2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1264 microversion: 2.1 time: 0.151974 Jan 19 13:21:32.210720 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 684/1374] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:32 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:33.229076 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f18880d7-b972-41a3-a2ae-24be0e59a352 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:33.229695 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f18880d7-b972-41a3-a2ae-24be0e59a352 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:33.235775 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f18880d7-b972-41a3-a2ae-24be0e59a352 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:33.236250 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f18880d7-b972-41a3-a2ae-24be0e59a352 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:33.237024 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f18880d7-b972-41a3-a2ae-24be0e59a352 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:33.237458 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f18880d7-b972-41a3-a2ae-24be0e59a352 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:33.365984 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f18880d7-b972-41a3-a2ae-24be0e59a352 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:33.374125 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f18880d7-b972-41a3-a2ae-24be0e59a352 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1264 microversion: 2.1 time: 0.150181 Jan 19 13:21:33.374694 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 691/1375] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:33 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:34.390721 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5e7475e8-fc40-4161-a906-31a29d0b2425 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:34.391330 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5e7475e8-fc40-4161-a906-31a29d0b2425 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:34.397926 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e7475e8-fc40-4161-a906-31a29d0b2425 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:34.398383 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e7475e8-fc40-4161-a906-31a29d0b2425 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:34.399167 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e7475e8-fc40-4161-a906-31a29d0b2425 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:34.399608 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5e7475e8-fc40-4161-a906-31a29d0b2425 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:34.529360 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5e7475e8-fc40-4161-a906-31a29d0b2425 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:34.536621 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5e7475e8-fc40-4161-a906-31a29d0b2425 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1264 microversion: 2.1 time: 0.149649 Jan 19 13:21:34.537187 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 685/1376] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:34 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:35.553364 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2ce23d79-f648-48bf-b0da-41484170bf14 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:35.553974 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2ce23d79-f648-48bf-b0da-41484170bf14 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:35.560403 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ce23d79-f648-48bf-b0da-41484170bf14 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:35.560863 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ce23d79-f648-48bf-b0da-41484170bf14 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:35.561653 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ce23d79-f648-48bf-b0da-41484170bf14 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:35.562095 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2ce23d79-f648-48bf-b0da-41484170bf14 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:35.694379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2ce23d79-f648-48bf-b0da-41484170bf14 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:35.702653 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2ce23d79-f648-48bf-b0da-41484170bf14 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1264 microversion: 2.1 time: 0.153011 Jan 19 13:21:35.703396 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 692/1377] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:35 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:36.719559 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-cd24a984-5f79-4ef9-a566-18e765af1d1f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:36.720185 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-cd24a984-5f79-4ef9-a566-18e765af1d1f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:36.726384 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cd24a984-5f79-4ef9-a566-18e765af1d1f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:36.726832 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cd24a984-5f79-4ef9-a566-18e765af1d1f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:36.727595 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cd24a984-5f79-4ef9-a566-18e765af1d1f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:36.728653 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-cd24a984-5f79-4ef9-a566-18e765af1d1f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:36.858400 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-cd24a984-5f79-4ef9-a566-18e765af1d1f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:36.865789 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-cd24a984-5f79-4ef9-a566-18e765af1d1f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1264 microversion: 2.1 time: 0.149865 Jan 19 13:21:36.866350 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 686/1378] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:36 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:37.882535 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-03d1ff4b-8fe9-46f3-8427-88301d07793d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:37.883147 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-03d1ff4b-8fe9-46f3-8427-88301d07793d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:37.890290 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-03d1ff4b-8fe9-46f3-8427-88301d07793d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:37.890746 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-03d1ff4b-8fe9-46f3-8427-88301d07793d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:37.891537 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-03d1ff4b-8fe9-46f3-8427-88301d07793d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:37.892028 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-03d1ff4b-8fe9-46f3-8427-88301d07793d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:38.023075 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-03d1ff4b-8fe9-46f3-8427-88301d07793d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:38.030270 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-03d1ff4b-8fe9-46f3-8427-88301d07793d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1264 microversion: 2.1 time: 0.151642 Jan 19 13:21:38.030830 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 693/1379] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:37 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:39.046107 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-062f4909-7b60-4f6a-bfd8-159449cb8f0b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:39.046708 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-062f4909-7b60-4f6a-bfd8-159449cb8f0b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:39.052931 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-062f4909-7b60-4f6a-bfd8-159449cb8f0b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:39.053378 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-062f4909-7b60-4f6a-bfd8-159449cb8f0b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:39.054144 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-062f4909-7b60-4f6a-bfd8-159449cb8f0b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:39.054581 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-062f4909-7b60-4f6a-bfd8-159449cb8f0b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:39.182280 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-062f4909-7b60-4f6a-bfd8-159449cb8f0b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:39.189552 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-062f4909-7b60-4f6a-bfd8-159449cb8f0b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1264 microversion: 2.1 time: 0.147294 Jan 19 13:21:39.190112 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 687/1380] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:39 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:40.205974 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c718bb23-65ff-44e2-b809-3829aa35dab3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:40.206618 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c718bb23-65ff-44e2-b809-3829aa35dab3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:40.212954 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c718bb23-65ff-44e2-b809-3829aa35dab3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:40.213407 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c718bb23-65ff-44e2-b809-3829aa35dab3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:40.214189 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c718bb23-65ff-44e2-b809-3829aa35dab3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:40.214632 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c718bb23-65ff-44e2-b809-3829aa35dab3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:40.351469 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-c718bb23-65ff-44e2-b809-3829aa35dab3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:40.359730 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c718bb23-65ff-44e2-b809-3829aa35dab3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1264 microversion: 2.1 time: 0.157411 Jan 19 13:21:40.360336 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 694/1381] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:40 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:41.376686 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-546aa144-c78e-48eb-a3d5-738c55f62caf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:41.377319 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-546aa144-c78e-48eb-a3d5-738c55f62caf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:41.383812 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-546aa144-c78e-48eb-a3d5-738c55f62caf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:41.384289 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-546aa144-c78e-48eb-a3d5-738c55f62caf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:41.385054 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-546aa144-c78e-48eb-a3d5-738c55f62caf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:41.385486 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-546aa144-c78e-48eb-a3d5-738c55f62caf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:41.519599 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-546aa144-c78e-48eb-a3d5-738c55f62caf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:41.526865 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-546aa144-c78e-48eb-a3d5-738c55f62caf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1264 microversion: 2.1 time: 0.153808 Jan 19 13:21:41.527424 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 688/1382] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:41 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:42.029230 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-f94cf979-83ff-49f1-b8fd-4ec33aed85c0 req-0145512c-082a-4e2e-8338-5f7a084f2dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a58b13b-d411-46c8-a4d4-4a319725e1d9", "name": "network-vif-plugged", "status": "completed", "tag": "0bf93f14-2a1f-46cb-bdb6-c14793e5af4b"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:21:42.030733 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:21:42.030733 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:21:42.037591 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-f94cf979-83ff-49f1-b8fd-4ec33aed85c0 req-0145512c-082a-4e2e-8338-5f7a084f2dd5 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:42.038045 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-f94cf979-83ff-49f1-b8fd-4ec33aed85c0 req-0145512c-082a-4e2e-8338-5f7a084f2dd5 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:42.049151 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-f94cf979-83ff-49f1-b8fd-4ec33aed85c0 req-0145512c-082a-4e2e-8338-5f7a084f2dd5 service nova] Creating event network-vif-plugged:0bf93f14-2a1f-46cb-bdb6-c14793e5af4b for instance 4a58b13b-d411-46c8-a4d4-4a319725e1d9 on hv-cinder-82301 Jan 19 13:21:42.053984 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-f94cf979-83ff-49f1-b8fd-4ec33aed85c0 req-0145512c-082a-4e2e-8338-5f7a084f2dd5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091111 Jan 19 13:21:42.054547 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 695/1383] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:21:42.544846 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-8c41aa87-2a2a-4c53-a884-974468854397 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:42.545454 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-8c41aa87-2a2a-4c53-a884-974468854397 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:42.551338 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8c41aa87-2a2a-4c53-a884-974468854397 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:42.551798 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8c41aa87-2a2a-4c53-a884-974468854397 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:42.552607 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8c41aa87-2a2a-4c53-a884-974468854397 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:42.553075 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-8c41aa87-2a2a-4c53-a884-974468854397 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:42.685458 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-8c41aa87-2a2a-4c53-a884-974468854397 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:42.692684 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-8c41aa87-2a2a-4c53-a884-974468854397 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1264 microversion: 2.1 time: 0.152031 Jan 19 13:21:42.693242 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 689/1384] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:42 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:43.711331 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-8e9cbb20-73e8-4330-8106-e080593f2330 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:43.712079 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-8e9cbb20-73e8-4330-8106-e080593f2330 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:43.718211 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8e9cbb20-73e8-4330-8106-e080593f2330 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:43.718667 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8e9cbb20-73e8-4330-8106-e080593f2330 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:43.719441 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8e9cbb20-73e8-4330-8106-e080593f2330 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:43.719879 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-8e9cbb20-73e8-4330-8106-e080593f2330 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:43.849943 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-8e9cbb20-73e8-4330-8106-e080593f2330 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:43.857883 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-8e9cbb20-73e8-4330-8106-e080593f2330 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1451 microversion: 2.1 time: 0.151050 Jan 19 13:21:43.858521 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 696/1385] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:43 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:43.874673 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-62eb6d7b-01cb-4f9d-b83a-b492a22099e9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:21:43.875292 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-62eb6d7b-01cb-4f9d-b83a-b492a22099e9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:21:43.882191 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-62eb6d7b-01cb-4f9d-b83a-b492a22099e9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:43.882647 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-62eb6d7b-01cb-4f9d-b83a-b492a22099e9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:43.883460 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-62eb6d7b-01cb-4f9d-b83a-b492a22099e9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:43.883903 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-62eb6d7b-01cb-4f9d-b83a-b492a22099e9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:44.021257 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-62eb6d7b-01cb-4f9d-b83a-b492a22099e9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:21:44.029729 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-62eb6d7b-01cb-4f9d-b83a-b492a22099e9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1451 microversion: 2.1 time: 0.159294 Jan 19 13:21:44.037085 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 690/1386] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:21:43 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:21:45.589555 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-e822911a-894a-4aa6-bdd6-6a2291d43c1d req-f8487152-26b7-4708-9bdf-22f74be3de77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a58b13b-d411-46c8-a4d4-4a319725e1d9", "tag": "0bf93f14-2a1f-46cb-bdb6-c14793e5af4b"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:21:45.591314 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:21:45.591314 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:21:45.599298 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-e822911a-894a-4aa6-bdd6-6a2291d43c1d req-f8487152-26b7-4708-9bdf-22f74be3de77 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:21:45.599776 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-e822911a-894a-4aa6-bdd6-6a2291d43c1d req-f8487152-26b7-4708-9bdf-22f74be3de77 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:21:45.610773 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-e822911a-894a-4aa6-bdd6-6a2291d43c1d req-f8487152-26b7-4708-9bdf-22f74be3de77 service nova] Creating event network-changed:0bf93f14-2a1f-46cb-bdb6-c14793e5af4b for instance 4a58b13b-d411-46c8-a4d4-4a319725e1d9 on hv-cinder-82301 Jan 19 13:21:45.615838 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-e822911a-894a-4aa6-bdd6-6a2291d43c1d req-f8487152-26b7-4708-9bdf-22f74be3de77 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029932 Jan 19 13:21:45.616534 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 697/1387] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:22:43.562642 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:22:43.563350 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: Wed Jan 19 13:22:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:23:45.501322 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dfaf7ae-58df-4d9f-8642-1fcb3bc7d466] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 19 13:23:45.504996 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1240276940", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-568706360", "security_groups": [{"name": "tempest-secgroup-smoke-377790272"}], "block_device_mapping_v2": [{"uuid": "5a707f5a-dad6-4ae2-b0fa-4d37f0dd63d1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "06087c42-5826-4410-a555-9454849c4c76"}]}} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:23:45.616508 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.network.neutron [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] validate_networks() for [('06087c42-5826-4410-a555-9454849c4c76', None, None, None, None, None)] {{(pid=116360) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 13:23:46.019291 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Flavor limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 13:23:46.019710 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Image limits 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 13:23:46.020215 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Flavor pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 13:23:46.020621 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Image pref 0:0:0 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 13:23:46.021054 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.virt.hardware [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 13:23:46.030207 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:46.030649 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:46.031447 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:46.031880 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:46.047584 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Getting quotas for project 70bd5865960e4d1aa33299835fd239c0. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 13:23:46.051380 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.quota [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Getting quotas for user 3d7f14cf5f5642618a22aa1f59329ba1 and project 70bd5865960e4d1aa33299835fd239c0. Resources: {'ram', 'cores', 'instances'} {{(pid=116360) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 13:23:46.104705 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Going to run 1 instances... {{(pid=116360) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 13:23:46.106884 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a707f5a-dad6-4ae2-b0fa-4d37f0dd63d1',volume_size=None,volume_type=None)] {{(pid=116360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 13:23:46.227378 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-f2297030-c53a-4d09-a8c6-ce40c532032b tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.727855 Jan 19 13:23:46.228226 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 691/1388] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Jan 19 13:23:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 13:23:46.236232 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8024c4d1-3d73-41ce-934b-e52ccdd322a4] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 19 13:23:46.240136 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-41be7986-7000-4ff4-9fd8-52391c1f1feb tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:23:46.240864 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-41be7986-7000-4ff4-9fd8-52391c1f1feb tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:23:46.535141 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-41be7986-7000-4ff4-9fd8-52391c1f1feb tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:23:46.541799 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-41be7986-7000-4ff4-9fd8-52391c1f1feb tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1094 microversion: 2.1 time: 0.307374 Jan 19 13:23:46.542360 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 698/1389] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:23:46 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1094 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:23:47.559088 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-550020cd-21fe-4923-8563-6e3dbc0c7770 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:23:47.559640 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-550020cd-21fe-4923-8563-6e3dbc0c7770 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:23:47.571118 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dfaf7ae-58df-4d9f-8642-1fcb3bc7d466] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 56990. Jan 19 13:23:47.612525 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-550020cd-21fe-4923-8563-6e3dbc0c7770 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:23:47.618929 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-550020cd-21fe-4923-8563-6e3dbc0c7770 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1094 microversion: 2.1 time: 0.064236 Jan 19 13:23:47.619477 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 692/1390] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:23:47 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:23:48.638099 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-84ce2b13-4121-4d53-b9e5-e74dbedd9c4e tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:23:48.638799 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-84ce2b13-4121-4d53-b9e5-e74dbedd9c4e tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:23:48.654826 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO oslo.messaging._drivers.impl_rabbit [-] [8024c4d1-3d73-41ce-934b-e52ccdd322a4] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 57000. Jan 19 13:23:48.701750 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-84ce2b13-4121-4d53-b9e5-e74dbedd9c4e tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:23:48.708361 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-84ce2b13-4121-4d53-b9e5-e74dbedd9c4e tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1094 microversion: 2.1 time: 0.075969 Jan 19 13:23:48.708914 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 699/1391] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:23:48 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:23:49.725475 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-1f93988a-163f-41af-8b54-f7116d5d83b9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:23:49.725999 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-1f93988a-163f-41af-8b54-f7116d5d83b9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:23:49.733136 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1f93988a-163f-41af-8b54-f7116d5d83b9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:49.733645 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1f93988a-163f-41af-8b54-f7116d5d83b9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:49.734428 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1f93988a-163f-41af-8b54-f7116d5d83b9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:49.734872 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-1f93988a-163f-41af-8b54-f7116d5d83b9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:49.792946 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-1f93988a-163f-41af-8b54-f7116d5d83b9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:23:49.800450 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-1f93988a-163f-41af-8b54-f7116d5d83b9 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1144 microversion: 2.1 time: 0.078716 Jan 19 13:23:49.801017 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 693/1392] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:23:49 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1144 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:23:50.817663 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-48cabf62-de0b-41dd-9197-fe47fc786cd5 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:23:50.818382 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-48cabf62-de0b-41dd-9197-fe47fc786cd5 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:23:50.826059 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-48cabf62-de0b-41dd-9197-fe47fc786cd5 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:50.827169 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-48cabf62-de0b-41dd-9197-fe47fc786cd5 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:50.827959 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-48cabf62-de0b-41dd-9197-fe47fc786cd5 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:50.828419 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-48cabf62-de0b-41dd-9197-fe47fc786cd5 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:50.893730 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-48cabf62-de0b-41dd-9197-fe47fc786cd5 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:23:50.901170 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-48cabf62-de0b-41dd-9197-fe47fc786cd5 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1192 microversion: 2.1 time: 0.087893 Jan 19 13:23:50.901726 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 700/1393] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:23:50 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:23:51.919102 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-28310852-9783-47e8-9c75-2b37554d7f5f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:23:51.919751 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-28310852-9783-47e8-9c75-2b37554d7f5f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:23:51.926187 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-28310852-9783-47e8-9c75-2b37554d7f5f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:51.926949 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-28310852-9783-47e8-9c75-2b37554d7f5f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:51.928256 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-28310852-9783-47e8-9c75-2b37554d7f5f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:51.928696 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-28310852-9783-47e8-9c75-2b37554d7f5f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:52.187022 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-28310852-9783-47e8-9c75-2b37554d7f5f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:23:52.194355 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-28310852-9783-47e8-9c75-2b37554d7f5f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1265 microversion: 2.1 time: 0.279506 Jan 19 13:23:52.194929 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 694/1394] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:23:51 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:23:52.543551 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-c09f57b8-8be5-4f1f-be17-28289eb9f6ca req-abe2815a-9e29-4094-b009-1e11397e7509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dccdb11a-cbff-43a7-8b3f-451a32aa8dcf", "tag": "00b8596d-faf7-4bc5-bfd4-e9fc6f018fa4"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:23:52.551101 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:23:52.551101 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:23:52.567307 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-c09f57b8-8be5-4f1f-be17-28289eb9f6ca req-abe2815a-9e29-4094-b009-1e11397e7509 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:52.568062 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-c09f57b8-8be5-4f1f-be17-28289eb9f6ca req-abe2815a-9e29-4094-b009-1e11397e7509 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:52.582073 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-c09f57b8-8be5-4f1f-be17-28289eb9f6ca req-abe2815a-9e29-4094-b009-1e11397e7509 service nova] Creating event network-changed:00b8596d-faf7-4bc5-bfd4-e9fc6f018fa4 for instance dccdb11a-cbff-43a7-8b3f-451a32aa8dcf on hv-cinder-82301 Jan 19 13:23:52.585510 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: ERROR oslo.messaging._drivers.impl_rabbit [req-c09f57b8-8be5-4f1f-be17-28289eb9f6ca req-abe2815a-9e29-4094-b009-1e11397e7509 service nova] [ac79783e-3796-417a-bb25-8ba7e1a92a54] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 19 13:23:53.211179 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-5c878b35-f58f-49e0-a9e1-2dc984a76546 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:23:53.211704 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-5c878b35-f58f-49e0-a9e1-2dc984a76546 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:23:53.218078 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5c878b35-f58f-49e0-a9e1-2dc984a76546 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:53.218530 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5c878b35-f58f-49e0-a9e1-2dc984a76546 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:53.219310 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5c878b35-f58f-49e0-a9e1-2dc984a76546 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:53.219757 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-5c878b35-f58f-49e0-a9e1-2dc984a76546 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:53.349302 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-5c878b35-f58f-49e0-a9e1-2dc984a76546 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:23:53.356498 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-5c878b35-f58f-49e0-a9e1-2dc984a76546 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1265 microversion: 2.1 time: 0.149163 Jan 19 13:23:53.357065 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 695/1395] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:23:53 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 13:23:53.593374 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO oslo.messaging._drivers.impl_rabbit [req-c09f57b8-8be5-4f1f-be17-28289eb9f6ca req-abe2815a-9e29-4094-b009-1e11397e7509 service nova] [ac79783e-3796-417a-bb25-8ba7e1a92a54] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 57018. Jan 19 13:23:53.596596 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-c09f57b8-8be5-4f1f-be17-28289eb9f6ca req-abe2815a-9e29-4094-b009-1e11397e7509 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.056865 Jan 19 13:23:53.597205 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 701/1396] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:23:54.373124 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-c09d026f-8213-4980-b13b-ce135e2ab2fd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:23:54.373877 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-c09d026f-8213-4980-b13b-ce135e2ab2fd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:23:54.380512 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c09d026f-8213-4980-b13b-ce135e2ab2fd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:54.380974 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c09d026f-8213-4980-b13b-ce135e2ab2fd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:54.381756 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c09d026f-8213-4980-b13b-ce135e2ab2fd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:54.382195 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-c09d026f-8213-4980-b13b-ce135e2ab2fd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:54.513173 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-c09d026f-8213-4980-b13b-ce135e2ab2fd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:23:54.521187 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-c09d026f-8213-4980-b13b-ce135e2ab2fd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1265 microversion: 2.1 time: 0.151922 Jan 19 13:23:54.521745 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 696/1397] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:23:54 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:23:55.539256 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-247d7738-ca0e-435c-96d0-c5482fa7da82 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:23:55.539902 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-247d7738-ca0e-435c-96d0-c5482fa7da82 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:23:55.546908 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-247d7738-ca0e-435c-96d0-c5482fa7da82 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:55.547364 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-247d7738-ca0e-435c-96d0-c5482fa7da82 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:55.548195 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-247d7738-ca0e-435c-96d0-c5482fa7da82 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:55.548643 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-247d7738-ca0e-435c-96d0-c5482fa7da82 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:55.680984 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-247d7738-ca0e-435c-96d0-c5482fa7da82 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:23:55.688888 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-247d7738-ca0e-435c-96d0-c5482fa7da82 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1265 microversion: 2.1 time: 0.154251 Jan 19 13:23:55.689456 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 702/1398] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:23:55 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:23:56.705495 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-799fec39-c67a-4342-b3a0-542ea05f1054 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:23:56.706104 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-799fec39-c67a-4342-b3a0-542ea05f1054 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:23:56.712626 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-799fec39-c67a-4342-b3a0-542ea05f1054 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:56.713073 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-799fec39-c67a-4342-b3a0-542ea05f1054 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:56.713852 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-799fec39-c67a-4342-b3a0-542ea05f1054 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:56.714296 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-799fec39-c67a-4342-b3a0-542ea05f1054 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:56.843322 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-799fec39-c67a-4342-b3a0-542ea05f1054 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:23:56.850535 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-799fec39-c67a-4342-b3a0-542ea05f1054 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1265 microversion: 2.1 time: 0.148704 Jan 19 13:23:56.851092 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 697/1399] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:23:56 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:23:57.866610 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4e9bbf5e-8557-479e-8427-2c29c32c88d2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:23:57.867229 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4e9bbf5e-8557-479e-8427-2c29c32c88d2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:23:57.874181 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4e9bbf5e-8557-479e-8427-2c29c32c88d2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:57.874634 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4e9bbf5e-8557-479e-8427-2c29c32c88d2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:57.875420 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4e9bbf5e-8557-479e-8427-2c29c32c88d2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:57.875864 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4e9bbf5e-8557-479e-8427-2c29c32c88d2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:58.011033 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4e9bbf5e-8557-479e-8427-2c29c32c88d2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:23:58.018414 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4e9bbf5e-8557-479e-8427-2c29c32c88d2 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1265 microversion: 2.1 time: 0.155484 Jan 19 13:23:58.018974 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 703/1400] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:23:57 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:23:59.035336 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-74664398-8173-4098-a184-3d0acddc0907 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:23:59.035868 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-74664398-8173-4098-a184-3d0acddc0907 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:23:59.042081 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-74664398-8173-4098-a184-3d0acddc0907 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:59.042524 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-74664398-8173-4098-a184-3d0acddc0907 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:59.043296 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-74664398-8173-4098-a184-3d0acddc0907 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:23:59.043739 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-74664398-8173-4098-a184-3d0acddc0907 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:23:59.172985 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-74664398-8173-4098-a184-3d0acddc0907 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:23:59.180140 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-74664398-8173-4098-a184-3d0acddc0907 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1265 microversion: 2.1 time: 0.148498 Jan 19 13:23:59.180693 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 698/1401] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:23:59 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:24:00.197215 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-a9cbc6bd-2b29-483b-9faa-23df19c815f3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:24:00.197753 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-a9cbc6bd-2b29-483b-9faa-23df19c815f3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:24:00.204074 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a9cbc6bd-2b29-483b-9faa-23df19c815f3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:00.209709 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a9cbc6bd-2b29-483b-9faa-23df19c815f3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:00.209709 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a9cbc6bd-2b29-483b-9faa-23df19c815f3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:00.209709 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-a9cbc6bd-2b29-483b-9faa-23df19c815f3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:00.340801 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-a9cbc6bd-2b29-483b-9faa-23df19c815f3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:24:00.348695 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-a9cbc6bd-2b29-483b-9faa-23df19c815f3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1265 microversion: 2.1 time: 0.155255 Jan 19 13:24:00.349254 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 704/1402] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:24:00 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:24:01.365146 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-88b823b8-38d7-427d-9c35-4a7bff0090e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:24:01.365750 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-88b823b8-38d7-427d-9c35-4a7bff0090e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:24:01.372073 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-88b823b8-38d7-427d-9c35-4a7bff0090e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:01.372598 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-88b823b8-38d7-427d-9c35-4a7bff0090e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:01.373467 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-88b823b8-38d7-427d-9c35-4a7bff0090e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:01.373930 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-88b823b8-38d7-427d-9c35-4a7bff0090e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:01.501592 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-88b823b8-38d7-427d-9c35-4a7bff0090e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:24:01.509113 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-88b823b8-38d7-427d-9c35-4a7bff0090e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1265 microversion: 2.1 time: 0.147745 Jan 19 13:24:01.509664 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 699/1403] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:24:01 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:24:02.525379 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-3823cf9a-1133-44fb-83b2-19c1ac4bc9fb tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:24:02.526036 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-3823cf9a-1133-44fb-83b2-19c1ac4bc9fb tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:24:02.532329 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3823cf9a-1133-44fb-83b2-19c1ac4bc9fb tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:02.532784 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3823cf9a-1133-44fb-83b2-19c1ac4bc9fb tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:02.533573 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3823cf9a-1133-44fb-83b2-19c1ac4bc9fb tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:02.534013 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-3823cf9a-1133-44fb-83b2-19c1ac4bc9fb tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:02.667787 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-3823cf9a-1133-44fb-83b2-19c1ac4bc9fb tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:24:02.675845 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-3823cf9a-1133-44fb-83b2-19c1ac4bc9fb tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1265 microversion: 2.1 time: 0.154023 Jan 19 13:24:02.676660 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 705/1404] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:24:02 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:24:03.693479 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ee05d210-247b-40fa-984a-58755e8d942f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:24:03.694097 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ee05d210-247b-40fa-984a-58755e8d942f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:24:03.701826 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ee05d210-247b-40fa-984a-58755e8d942f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:03.702275 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ee05d210-247b-40fa-984a-58755e8d942f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:03.703055 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ee05d210-247b-40fa-984a-58755e8d942f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:03.703495 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ee05d210-247b-40fa-984a-58755e8d942f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:03.831057 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ee05d210-247b-40fa-984a-58755e8d942f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:24:03.838275 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ee05d210-247b-40fa-984a-58755e8d942f tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1265 microversion: 2.1 time: 0.148808 Jan 19 13:24:03.838837 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 700/1405] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:24:03 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:24:04.788307 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [req-279d0f5d-5d63-4939-812d-2b066802c875 req-eda4b6be-5fe9-43b9-aac5-fda9d1ee1139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dccdb11a-cbff-43a7-8b3f-451a32aa8dcf", "name": "network-vif-plugged", "status": "completed", "tag": "00b8596d-faf7-4bc5-bfd4-e9fc6f018fa4"}]} {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:24:04.789864 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:24:04.789864 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: warnings.warn(msg) Jan 19 13:24:04.797261 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-279d0f5d-5d63-4939-812d-2b066802c875 req-eda4b6be-5fe9-43b9-aac5-fda9d1ee1139 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:04.797712 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [req-279d0f5d-5d63-4939-812d-2b066802c875 req-eda4b6be-5fe9-43b9-aac5-fda9d1ee1139 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:04.808564 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.compute.server_external_events [req-279d0f5d-5d63-4939-812d-2b066802c875 req-eda4b6be-5fe9-43b9-aac5-fda9d1ee1139 service nova] Creating event network-vif-plugged:00b8596d-faf7-4bc5-bfd4-e9fc6f018fa4 for instance dccdb11a-cbff-43a7-8b3f-451a32aa8dcf on hv-cinder-82301 Jan 19 13:24:04.813788 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [req-279d0f5d-5d63-4939-812d-2b066802c875 req-eda4b6be-5fe9-43b9-aac5-fda9d1ee1139 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029051 Jan 19 13:24:04.814492 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 706/1406] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 13:24:04.854416 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-53704c23-9cee-422c-8b0d-dd025cf62fbf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:24:04.855019 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-53704c23-9cee-422c-8b0d-dd025cf62fbf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:24:04.861937 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-53704c23-9cee-422c-8b0d-dd025cf62fbf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:04.862392 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-53704c23-9cee-422c-8b0d-dd025cf62fbf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:04.863172 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-53704c23-9cee-422c-8b0d-dd025cf62fbf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:04.863606 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-53704c23-9cee-422c-8b0d-dd025cf62fbf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:05.006008 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-53704c23-9cee-422c-8b0d-dd025cf62fbf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:24:05.013766 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-53704c23-9cee-422c-8b0d-dd025cf62fbf tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1265 microversion: 2.1 time: 0.162510 Jan 19 13:24:05.014343 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 701/1407] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:24:04 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:24:06.031662 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-f760061d-34e6-4b31-8a3f-49f06d8458ee tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:24:06.032387 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-f760061d-34e6-4b31-8a3f-49f06d8458ee tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:24:06.038650 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f760061d-34e6-4b31-8a3f-49f06d8458ee tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:06.039097 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f760061d-34e6-4b31-8a3f-49f06d8458ee tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:06.039871 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f760061d-34e6-4b31-8a3f-49f06d8458ee tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:06.040330 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-f760061d-34e6-4b31-8a3f-49f06d8458ee tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:06.180988 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-f760061d-34e6-4b31-8a3f-49f06d8458ee tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:24:06.189352 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-f760061d-34e6-4b31-8a3f-49f06d8458ee tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1265 microversion: 2.1 time: 0.162626 Jan 19 13:24:06.189915 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 707/1408] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:24:06 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:24:07.205876 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-ad9d30fd-3d26-4e6c-8fa1-89b0b9001387 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:24:07.206482 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-ad9d30fd-3d26-4e6c-8fa1-89b0b9001387 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:24:07.212776 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad9d30fd-3d26-4e6c-8fa1-89b0b9001387 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:07.213223 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad9d30fd-3d26-4e6c-8fa1-89b0b9001387 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:07.213985 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad9d30fd-3d26-4e6c-8fa1-89b0b9001387 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:07.214416 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-ad9d30fd-3d26-4e6c-8fa1-89b0b9001387 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:07.347443 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-ad9d30fd-3d26-4e6c-8fa1-89b0b9001387 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:24:07.354825 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-ad9d30fd-3d26-4e6c-8fa1-89b0b9001387 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1452 microversion: 2.1 time: 0.152550 Jan 19 13:24:07.355391 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 702/1409] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:24:07 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:24:07.371042 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-4685fb48-20fd-4285-a81f-a4e20f2a2e1d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:24:07.371645 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-4685fb48-20fd-4285-a81f-a4e20f2a2e1d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:24:07.377947 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4685fb48-20fd-4285-a81f-a4e20f2a2e1d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:07.378412 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4685fb48-20fd-4285-a81f-a4e20f2a2e1d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:07.379160 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4685fb48-20fd-4285-a81f-a4e20f2a2e1d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:07.379594 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-4685fb48-20fd-4285-a81f-a4e20f2a2e1d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:07.508256 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-4685fb48-20fd-4285-a81f-a4e20f2a2e1d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:24:07.515500 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-4685fb48-20fd-4285-a81f-a4e20f2a2e1d tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1452 microversion: 2.1 time: 0.148024 Jan 19 13:24:07.516087 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 708/1410] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:24:07 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:24:09.321933 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-385f5496-cb0e-4a2b-891f-8a4cf613bb21 req-fff7cfaf-e467-4e18-9838-f25a0876c1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dccdb11a-cbff-43a7-8b3f-451a32aa8dcf", "tag": "00b8596d-faf7-4bc5-bfd4-e9fc6f018fa4"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:24:09.324024 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:24:09.324024 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:24:09.334079 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-385f5496-cb0e-4a2b-891f-8a4cf613bb21 req-fff7cfaf-e467-4e18-9838-f25a0876c1e7 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:24:09.334893 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-385f5496-cb0e-4a2b-891f-8a4cf613bb21 req-fff7cfaf-e467-4e18-9838-f25a0876c1e7 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:24:09.346400 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-385f5496-cb0e-4a2b-891f-8a4cf613bb21 req-fff7cfaf-e467-4e18-9838-f25a0876c1e7 service nova] Creating event network-changed:00b8596d-faf7-4bc5-bfd4-e9fc6f018fa4 for instance dccdb11a-cbff-43a7-8b3f-451a32aa8dcf on hv-cinder-82301 Jan 19 13:24:09.349860 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: ERROR oslo.messaging._drivers.impl_rabbit [req-385f5496-cb0e-4a2b-891f-8a4cf613bb21 req-fff7cfaf-e467-4e18-9838-f25a0876c1e7 service nova] [bdf71640-e111-4e85-a222-1dd187ceb8c2] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 19 13:24:10.358800 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO oslo.messaging._drivers.impl_rabbit [req-385f5496-cb0e-4a2b-891f-8a4cf613bb21 req-fff7cfaf-e467-4e18-9838-f25a0876c1e7 service nova] [bdf71640-e111-4e85-a222-1dd187ceb8c2] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 57056. Jan 19 13:24:10.362154 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-385f5496-cb0e-4a2b-891f-8a4cf613bb21 req-fff7cfaf-e467-4e18-9838-f25a0876c1e7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.044073 Jan 19 13:24:10.362849 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 703/1411] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:24:19.570210 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:24:19.570773 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: Wed Jan 19 13:24:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:24:26.408111 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:24:26.408650 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: Wed Jan 19 13:24:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:25:59.119599 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d6e41f55-c528-425d-bcc7-04a5eda81de3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:25:59.120202 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d6e41f55-c528-425d-bcc7-04a5eda81de3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:25:59.121213 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dfaf7ae-58df-4d9f-8642-1fcb3bc7d466] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 19 13:25:59.126879 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d6e41f55-c528-425d-bcc7-04a5eda81de3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:25:59.127392 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d6e41f55-c528-425d-bcc7-04a5eda81de3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:25:59.127561 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-eb165a4d-931f-479c-bbe8-726dac4fda04 req-8f009d7e-329d-4cd0-a0d7-5fb30859c149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dccdb11a-cbff-43a7-8b3f-451a32aa8dcf", "tag": "00b8596d-faf7-4bc5-bfd4-e9fc6f018fa4"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:25:59.128333 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d6e41f55-c528-425d-bcc7-04a5eda81de3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:25:59.128855 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d6e41f55-c528-425d-bcc7-04a5eda81de3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:25:59.129762 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:25:59.129762 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:25:59.137068 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-eb165a4d-931f-479c-bbe8-726dac4fda04 req-8f009d7e-329d-4cd0-a0d7-5fb30859c149 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:25:59.137607 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-eb165a4d-931f-479c-bbe8-726dac4fda04 req-8f009d7e-329d-4cd0-a0d7-5fb30859c149 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:25:59.148848 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-eb165a4d-931f-479c-bbe8-726dac4fda04 req-8f009d7e-329d-4cd0-a0d7-5fb30859c149 service nova] Creating event network-changed:00b8596d-faf7-4bc5-bfd4-e9fc6f018fa4 for instance dccdb11a-cbff-43a7-8b3f-451a32aa8dcf on hv-cinder-82301 Jan 19 13:25:59.155672 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-eb165a4d-931f-479c-bbe8-726dac4fda04 req-8f009d7e-329d-4cd0-a0d7-5fb30859c149 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038097 Jan 19 13:25:59.156318 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 704/1412] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:25:59.156790 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d6e41f55-c528-425d-bcc7-04a5eda81de3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Going to try to terminate instance {{(pid=116361) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:25:59.236217 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d6e41f55-c528-425d-bcc7-04a5eda81de3 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 204 len: 0 microversion: 2.1 time: 0.121861 Jan 19 13:25:59.237306 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 709/1413] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:25:59 2022] DELETE /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:25:59.248143 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-19344971-3104-4b79-a077-16e287f235d1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:25:59.248967 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-19344971-3104-4b79-a077-16e287f235d1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:25:59.256403 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-19344971-3104-4b79-a077-16e287f235d1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:25:59.256950 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-19344971-3104-4b79-a077-16e287f235d1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:25:59.257830 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-19344971-3104-4b79-a077-16e287f235d1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:25:59.258337 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-19344971-3104-4b79-a077-16e287f235d1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:25:59.479303 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-19344971-3104-4b79-a077-16e287f235d1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:25:59.487935 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-19344971-3104-4b79-a077-16e287f235d1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1577 microversion: 2.1 time: 0.245423 Jan 19 13:25:59.488972 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 705/1414] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:25:59 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1577 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:26:00.507403 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-54d095d9-b06f-4411-b0e4-1a46bbb03d71 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:26:00.508040 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-54d095d9-b06f-4411-b0e4-1a46bbb03d71 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:26:00.515010 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54d095d9-b06f-4411-b0e4-1a46bbb03d71 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:00.515460 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54d095d9-b06f-4411-b0e4-1a46bbb03d71 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:00.516262 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54d095d9-b06f-4411-b0e4-1a46bbb03d71 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:00.516703 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-54d095d9-b06f-4411-b0e4-1a46bbb03d71 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:00.651459 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-54d095d9-b06f-4411-b0e4-1a46bbb03d71 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:26:00.659064 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-54d095d9-b06f-4411-b0e4-1a46bbb03d71 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1458 microversion: 2.1 time: 0.156048 Jan 19 13:26:00.659624 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 710/1415] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:26:00 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1458 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:26:01.499263 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-a9aa14dd-04cb-48d4-b2c0-57b15cf4f460 req-52a607cd-10da-489a-afa5-62193b3fe461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dccdb11a-cbff-43a7-8b3f-451a32aa8dcf", "name": "network-vif-deleted", "tag": "00b8596d-faf7-4bc5-bfd4-e9fc6f018fa4"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:26:01.501745 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:26:01.501745 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:26:01.515014 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-a9aa14dd-04cb-48d4-b2c0-57b15cf4f460 req-52a607cd-10da-489a-afa5-62193b3fe461 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:01.515581 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-a9aa14dd-04cb-48d4-b2c0-57b15cf4f460 req-52a607cd-10da-489a-afa5-62193b3fe461 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:01.529485 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-a9aa14dd-04cb-48d4-b2c0-57b15cf4f460 req-52a607cd-10da-489a-afa5-62193b3fe461 service nova] Creating event network-vif-deleted:00b8596d-faf7-4bc5-bfd4-e9fc6f018fa4 for instance dccdb11a-cbff-43a7-8b3f-451a32aa8dcf on hv-cinder-82301 Jan 19 13:26:01.535933 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-a9aa14dd-04cb-48d4-b2c0-57b15cf4f460 req-52a607cd-10da-489a-afa5-62193b3fe461 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043036 Jan 19 13:26:01.536555 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 706/1416] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:26:01.675136 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2392639c-583b-4ddf-b0d1-6354c3b64ae4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:26:01.675727 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-2392639c-583b-4ddf-b0d1-6354c3b64ae4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:26:01.681993 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2392639c-583b-4ddf-b0d1-6354c3b64ae4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:01.682442 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2392639c-583b-4ddf-b0d1-6354c3b64ae4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:01.683217 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2392639c-583b-4ddf-b0d1-6354c3b64ae4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:01.683651 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-2392639c-583b-4ddf-b0d1-6354c3b64ae4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:01.743677 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-2392639c-583b-4ddf-b0d1-6354c3b64ae4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:26:01.751179 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2392639c-583b-4ddf-b0d1-6354c3b64ae4 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 200 len: 1225 microversion: 2.1 time: 0.079756 Jan 19 13:26:01.751747 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 711/1417] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:26:01 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:26:02.766113 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dfaf7ae-58df-4d9f-8642-1fcb3bc7d466] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 57110. Jan 19 13:26:02.769893 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-faca6f6e-4ec9-40ba-af28-d16723774961 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:26:02.770588 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-faca6f6e-4ec9-40ba-af28-d16723774961 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: dccdb11a-cbff-43a7-8b3f-451a32aa8dcf] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:26:02.776879 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-faca6f6e-4ec9-40ba-af28-d16723774961 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:02.777337 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-faca6f6e-4ec9-40ba-af28-d16723774961 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:02.778648 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-faca6f6e-4ec9-40ba-af28-d16723774961 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:02.779098 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-faca6f6e-4ec9-40ba-af28-d16723774961 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:02.791742 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-faca6f6e-4ec9-40ba-af28-d16723774961 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] HTTP exception thrown: Instance dccdb11a-cbff-43a7-8b3f-451a32aa8dcf could not be found. Jan 19 13:26:02.792346 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-faca6f6e-4ec9-40ba-af28-d16723774961 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Returning 404 to user: Instance dccdb11a-cbff-43a7-8b3f-451a32aa8dcf could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:26:02.793151 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-faca6f6e-4ec9-40ba-af28-d16723774961 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf" status: 404 len: 111 microversion: 2.1 time: 0.028249 Jan 19 13:26:02.794533 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 707/1418] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:26:02 2022] GET /compute/v2.1/servers/dccdb11a-cbff-43a7-8b3f-451a32aa8dcf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:26:03.571170 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:26:03.571804 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: Wed Jan 19 13:26:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:26:06.073167 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-dc96dea7-b55c-4f29-839b-eff4413e0217 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:26:06.073806 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-dc96dea7-b55c-4f29-839b-eff4413e0217 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:26:06.075105 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-044ee60a-6fa3-45ee-9336-2948f2819287 req-6fd0b912-44c2-4106-bfbf-70706b1f6299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a58b13b-d411-46c8-a4d4-4a319725e1d9", "tag": "0bf93f14-2a1f-46cb-bdb6-c14793e5af4b"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:26:06.077266 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:26:06.077266 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:26:06.080395 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dc96dea7-b55c-4f29-839b-eff4413e0217 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:06.080853 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dc96dea7-b55c-4f29-839b-eff4413e0217 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:06.081639 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dc96dea7-b55c-4f29-839b-eff4413e0217 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:06.082079 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-dc96dea7-b55c-4f29-839b-eff4413e0217 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:06.085319 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-044ee60a-6fa3-45ee-9336-2948f2819287 req-6fd0b912-44c2-4106-bfbf-70706b1f6299 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:06.085477 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-044ee60a-6fa3-45ee-9336-2948f2819287 req-6fd0b912-44c2-4106-bfbf-70706b1f6299 service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:06.097536 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-044ee60a-6fa3-45ee-9336-2948f2819287 req-6fd0b912-44c2-4106-bfbf-70706b1f6299 service nova] Creating event network-changed:0bf93f14-2a1f-46cb-bdb6-c14793e5af4b for instance 4a58b13b-d411-46c8-a4d4-4a319725e1d9 on hv-cinder-82301 Jan 19 13:26:06.102025 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-044ee60a-6fa3-45ee-9336-2948f2819287 req-6fd0b912-44c2-4106-bfbf-70706b1f6299 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030506 Jan 19 13:26:06.102934 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 708/1419] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:26:06.108516 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-dc96dea7-b55c-4f29-839b-eff4413e0217 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Going to try to terminate instance {{(pid=116361) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 13:26:06.209648 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-dc96dea7-b55c-4f29-839b-eff4413e0217 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 204 len: 0 microversion: 2.1 time: 0.140282 Jan 19 13:26:06.217903 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 712/1420] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:26:06 2022] DELETE /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 13:26:06.219564 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-19acba31-9254-4d63-86ef-bc5da59d2731 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:26:06.220396 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-19acba31-9254-4d63-86ef-bc5da59d2731 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:26:06.226768 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-19acba31-9254-4d63-86ef-bc5da59d2731 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:06.227302 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-19acba31-9254-4d63-86ef-bc5da59d2731 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:06.228382 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-19acba31-9254-4d63-86ef-bc5da59d2731 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:06.228918 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-19acba31-9254-4d63-86ef-bc5da59d2731 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:06.458167 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.policy [None req-19acba31-9254-4d63-86ef-bc5da59d2731 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116360) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:26:06.466867 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-19acba31-9254-4d63-86ef-bc5da59d2731 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1576 microversion: 2.1 time: 0.251496 Jan 19 13:26:06.467443 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 709/1421] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:26:06 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1576 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:26:07.485629 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-d8c8b832-6544-4920-958e-5fb7e6dc6e69 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:26:07.486240 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-d8c8b832-6544-4920-958e-5fb7e6dc6e69 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:26:07.493255 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d8c8b832-6544-4920-958e-5fb7e6dc6e69 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:07.493704 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d8c8b832-6544-4920-958e-5fb7e6dc6e69 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:07.494488 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d8c8b832-6544-4920-958e-5fb7e6dc6e69 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:07.494954 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-d8c8b832-6544-4920-958e-5fb7e6dc6e69 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:07.626935 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-d8c8b832-6544-4920-958e-5fb7e6dc6e69 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:26:07.634538 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-d8c8b832-6544-4920-958e-5fb7e6dc6e69 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1457 microversion: 2.1 time: 0.154208 Jan 19 13:26:07.635096 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 713/1422] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:26:07 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1457 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:26:08.249441 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [req-b9d086d6-ae1c-40d8-a1e0-0738e74ab81a req-a8ad43e8-f15f-4aa8-bb16-95dc9f48b27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a58b13b-d411-46c8-a4d4-4a319725e1d9", "name": "network-vif-deleted", "tag": "0bf93f14-2a1f-46cb-bdb6-c14793e5af4b"}]} {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 13:26:08.251169 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 13:26:08.251169 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: warnings.warn(msg) Jan 19 13:26:08.258909 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-b9d086d6-ae1c-40d8-a1e0-0738e74ab81a req-a8ad43e8-f15f-4aa8-bb16-95dc9f48b27d service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:08.259351 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [req-b9d086d6-ae1c-40d8-a1e0-0738e74ab81a req-a8ad43e8-f15f-4aa8-bb16-95dc9f48b27d service nova] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:08.272214 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.compute.server_external_events [req-b9d086d6-ae1c-40d8-a1e0-0738e74ab81a req-a8ad43e8-f15f-4aa8-bb16-95dc9f48b27d service nova] Creating event network-vif-deleted:0bf93f14-2a1f-46cb-bdb6-c14793e5af4b for instance 4a58b13b-d411-46c8-a4d4-4a319725e1d9 on hv-cinder-82301 Jan 19 13:26:08.276727 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [req-b9d086d6-ae1c-40d8-a1e0-0738e74ab81a req-a8ad43e8-f15f-4aa8-bb16-95dc9f48b27d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031042 Jan 19 13:26:08.277301 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 710/1423] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Jan 19 13:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 13:26:08.652203 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-c5eec0f9-7849-4741-bbf5-94463ba2f1cc tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:26:08.652814 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-c5eec0f9-7849-4741-bbf5-94463ba2f1cc tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:26:08.660083 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5eec0f9-7849-4741-bbf5-94463ba2f1cc tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:08.660542 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5eec0f9-7849-4741-bbf5-94463ba2f1cc tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:08.661332 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5eec0f9-7849-4741-bbf5-94463ba2f1cc tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:08.661775 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5eec0f9-7849-4741-bbf5-94463ba2f1cc tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:08.691489 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5eec0f9-7849-4741-bbf5-94463ba2f1cc tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:08.691878 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-c5eec0f9-7849-4741-bbf5-94463ba2f1cc tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:08.692356 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.objects.instance [None req-c5eec0f9-7849-4741-bbf5-94463ba2f1cc tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lazy-loading 'fault' on Instance uuid 4a58b13b-d411-46c8-a4d4-4a319725e1d9 {{(pid=116361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 13:26:08.731802 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.policy [None req-c5eec0f9-7849-4741-bbf5-94463ba2f1cc tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7f14cf5f5642618a22aa1f59329ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bd5865960e4d1aa33299835fd239c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116361) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 13:26:08.739513 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-c5eec0f9-7849-4741-bbf5-94463ba2f1cc tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 200 len: 1229 microversion: 2.1 time: 0.091094 Jan 19 13:26:08.740103 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 714/1424] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:26:08 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 1229 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 13:26:09.758134 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-37bda2d7-6689-435b-bf5b-a5498666d788 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:26:09.759031 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-37bda2d7-6689-435b-bf5b-a5498666d788 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 4a58b13b-d411-46c8-a4d4-4a319725e1d9] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:26:09.765631 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-37bda2d7-6689-435b-bf5b-a5498666d788 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:09.766080 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-37bda2d7-6689-435b-bf5b-a5498666d788 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:09.766859 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-37bda2d7-6689-435b-bf5b-a5498666d788 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:09.767321 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-37bda2d7-6689-435b-bf5b-a5498666d788 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:09.780546 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-37bda2d7-6689-435b-bf5b-a5498666d788 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] HTTP exception thrown: Instance 4a58b13b-d411-46c8-a4d4-4a319725e1d9 could not be found. Jan 19 13:26:09.781120 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-37bda2d7-6689-435b-bf5b-a5498666d788 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Returning 404 to user: Instance 4a58b13b-d411-46c8-a4d4-4a319725e1d9 could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:26:09.781918 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-37bda2d7-6689-435b-bf5b-a5498666d788 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9" status: 404 len: 111 microversion: 2.1 time: 0.028651 Jan 19 13:26:09.782436 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 711/1425] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:26:09 2022] GET /compute/v2.1/servers/4a58b13b-d411-46c8-a4d4-4a319725e1d9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 13:26:10.217690 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-17002523-a5e1-4f6c-b5a5-1a391b8290e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:26:10.218180 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.compute.api [None req-17002523-a5e1-4f6c-b5a5-1a391b8290e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116361) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:26:10.224447 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-17002523-a5e1-4f6c-b5a5-1a391b8290e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:10.224899 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-17002523-a5e1-4f6c-b5a5-1a391b8290e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:10.225671 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-17002523-a5e1-4f6c-b5a5-1a391b8290e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:10.226107 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG oslo_concurrency.lockutils [None req-17002523-a5e1-4f6c-b5a5-1a391b8290e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:10.239281 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.wsgi [None req-17002523-a5e1-4f6c-b5a5-1a391b8290e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] HTTP exception thrown: Instance 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d could not be found. Jan 19 13:26:10.239856 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-17002523-a5e1-4f6c-b5a5-1a391b8290e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Returning 404 to user: Instance 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d could not be found. {{(pid=116361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:26:10.240685 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-17002523-a5e1-4f6c-b5a5-1a391b8290e1 tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "DELETE /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 404 len: 111 microversion: 2.1 time: 0.027875 Jan 19 13:26:10.241204 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 715/1426] 10.222.0.48 () {58 vars in 1238 bytes} [Wed Jan 19 13:26:10 2022] DELETE /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:26:10.249422 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-da3596c4-0ae6-4f58-894f-37533b2d0dfd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '>' {{(pid=116360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:26:10.250022 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.compute.api [None req-da3596c4-0ae6-4f58-894f-37533b2d0dfd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] [instance: 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d] Fetching instance by UUID {{(pid=116360) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 13:26:10.256031 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da3596c4-0ae6-4f58-894f-37533b2d0dfd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:10.256477 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da3596c4-0ae6-4f58-894f-37533b2d0dfd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:10.257238 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da3596c4-0ae6-4f58-894f-37533b2d0dfd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 13:26:10.257668 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG oslo_concurrency.lockutils [None req-da3596c4-0ae6-4f58-894f-37533b2d0dfd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Lock "f40e5328-425f-45ad-99cf-718290ac762d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 13:26:10.270683 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.wsgi [None req-da3596c4-0ae6-4f58-894f-37533b2d0dfd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] HTTP exception thrown: Instance 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d could not be found. Jan 19 13:26:10.271250 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: DEBUG nova.api.openstack.wsgi [None req-da3596c4-0ae6-4f58-894f-37533b2d0dfd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Returning 404 to user: Instance 585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d could not be found. {{(pid=116360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 13:26:10.272070 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO nova.api.openstack.requestlog [None req-da3596c4-0ae6-4f58-894f-37533b2d0dfd tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d" status: 404 len: 111 microversion: 2.1 time: 0.026806 Jan 19 13:26:10.272576 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: [pid: 116360|app: 0|req: 712/1427] 10.222.0.48 () {58 vars in 1235 bytes} [Wed Jan 19 13:26:10 2022] GET /compute/v2.1/servers/585be3d9-6ef7-4ed7-ab7f-1f7c62deef8d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 13:26:11.548095 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: DEBUG nova.api.openstack.wsgi [None req-2c462f00-12c4-48b2-b1d4-a15ea7344d3e tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] Calling method '.version_select at 0x7f07d7a9b430>' {{(pid=116361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 13:26:11.570873 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO nova.api.openstack.requestlog [None req-2c462f00-12c4-48b2-b1d4-a15ea7344d3e tempest-TestVolumeBootPattern-414175188 tempest-TestVolumeBootPattern-414175188-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-568706360" status: 202 len: 0 microversion: 2.1 time: 0.026567 Jan 19 13:26:11.571505 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: [pid: 116361|app: 0|req: 716/1428] 10.222.0.48 () {58 vars in 1259 bytes} [Wed Jan 19 13:26:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-568706360 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 13:26:14.457823 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:26:14.458354 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: Wed Jan 19 13:26:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:27:39.579711 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:27:39.580461 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: Wed Jan 19 13:27:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:27:46.415923 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:27:46.416533 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: Wed Jan 19 13:27:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:29:23.580683 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:29:23.581303 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: Wed Jan 19 13:29:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:29:34.466714 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:29:34.467319 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: Wed Jan 19 13:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:30:59.587534 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:30:59.588271 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: Wed Jan 19 13:30:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:31:06.425117 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:31:06.425673 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: Wed Jan 19 13:31:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:31:26.661916 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:31:26.662657 dv-cinder-823015-4-iscsi devstack@n-api.service[116360]: Wed Jan 19 13:31:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 13:31:29.465954 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 13:31:29.466532 dv-cinder-823015-4-iscsi devstack@n-api.service[116361]: Wed Jan 19 13:31:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!